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PREFACE 


Recent  popular  literature  abounds  with  articles  on  fractals  or  chaos. 
Laynen  will  find  them  quite  accessible,  except  for  occasional  stumbling  blocks 
like  dimension,  self-similarity,  dynamics,  randomness,  etc.  But  technical 
readers  will  likely  be  frustrated  by  a  lack  of  detail.  This  report  assumes 
the  reader  has  a  mathematical  background  equivalent  to  an  upper-division  math 
major.  The  report  is  being  used  as  the  textbook  for  a  Math  495  course 
during  spring,  1989. 

The  popularity  of  fractals  and  chaos  is  not  an  accident.  There  is  an 
amazing  number  of  natural  phenomena  which  can  be  interpreted  by  either 
fractals  or  chaos  or  both.  It  is  more  surprising  that  these  fields  weren't 
"discovered"  until  the  mid-1970's.  Benoit  Mandelbrot  noticed  that  many 
geographic  entities — coast  lines,  mountains,  etc. — could  be  thought  of  as 
having  a  "fractional  dimension";  hence,  fractal.  Mitchell  Feigenbaum 
theorized  universal  properties  of  certain  "chaotic  processes".  For  example, 
fluid  turbulence  and  a  nonlinear  oscillator  exhibit  similar  qualitative  and 
quantitative  behavior. 

Mathematicians  became  interested  when  old  topics  like  Hausdorff  Dimension, 
Ergodic  Theory,  and  everything  In  between  were  found  to  have  applications  and 
to  have  the  ability  to  make  pretty  computer  graphics.  Fractals  and  chaos  have 
become  such  hot  topics  that  they  have  worked  their  way  into  the  diverse  fields 
of  art  and  biology. 

The  eager  researcher  will  jump  at  (or  contrive)  any  opportunity  to  say 
"Ha,  a  fractal!"  or,  "Ha,  chaos!"  But:  FRACTALS  AND  CHAOS  ARE  NOT  MODELS  OF 
NATURE.  THEY  ARE,  AT  BEST,  SYMPTOMS.  It  is  like  noting  that  the  sky  is  blue. 
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Quite  often,  knowing  an  object  is  a  fractal  or  a  process  is  chaotic  will  not 
give  any  new  information  about  that  object  or  process. 

In  the  author's  opinion,  the  classification  of  something  as  a  fractal  or 
chaotic  process  is  most  useful  from  a  "first  principles"  point  of  view.  For 
example,  it  has  been  known  for  some  time  that  clouds  are  self-similar 
(fractals)  on  a  scale  of  about  10  km  on  down.  More  recently,  from  satellite 
photographs,  it  was  found  that  they're  actually  self-similar  on  a  scale  of 
1000  km  on  down!  This  information  is  useful  in  the  sense  that  any  valid 
theory  on  the  formation  of  clouds  must  address  this  large-scale 
self-similiarity .  Likewise,  population  growth  in  nature  exhibits  chaotic 
behavior.  So,  there  are  definite  limits  to  a  non-chaotic  (exponential  growth, 
for  instance)  model's  applicability. 

The  goal  of  this  report  is  to  give  a  basic  foundation  upon  which  the 
interested  researcher  may  "build-to-suit".  To  this  end,  and  for  the  Math  415 
students,  exercises  will  be  found  at  the  end  of  many  sections.  There  are 
several  computer  programs  available  (for  the  Z-248  with  EGA)  which  illustrate 
the  ideas  presented  in  this  report. 

If  this  is  your  first  encounter  with  the  ideas  in  and  the  applications  of 
fractals  and  chaos,  I  hope  you  find  them  as  enjoyable  and  amazing  as  I  do. 
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1.1  Introduction 


It  is  hard  to  date  ideas  to  their  true  originators.  But  "fractional 
dimension"  is  largely  due  to  the  work  of  Felix  Hausdorff  (1868-1942).  This  was 
a  mathematical  formulation  and  was  not  necessarily  thought  to  have  real-world 
applications. 

Scientists  and  philosphers  have  noticed  basic  patterns  and  "self-simi¬ 
larity"  in  nature  throughout  history.  However,  it  is  probably  safe  to  say 
that  Benoit  Mandelbrot  was  the  first  person  to  successfully  integrate 
fractional  dimension  with  self-similar  natural  phenomena.  He  was  the  one  to 
coin  the  term  "fractal" — without  explicitly  defining  it  at  first,  but  later 
giving  it  a  mathematical  definition. 

Much  of  the  popularity  of  fractals  is  a  result  of  the  relatively  recent 
advances  in  computer  graphics.  Mandelbrot,  who  works  for  IBM,  was  able  to 
turn  out  some  spectacular  images  of  fractals  simulating  geographic  shapes — 
like  a  false  F.arth-rise  as  seen  from  a  false  moon.  Many  scientists  and  com¬ 
puter  enthusiasts  have  expanded  on  his  work.  Fractal  images  now  seem  to  be 
the  cover  picture  of  choice  on  calculus  textbooks. 

Some  of  the  most  promising  work  in  fractals  has  been  done  by  Michael 
Barnsley  of  Ceorgia  Tech.  (He  is  funded  by  PARPA  and  AFOSR,  among  others.) 
Barnsely's  work  centers  on  the  question:  Given  a  digitized  image  on  a  monitor, 
(with  resolution  of,  say,  1024  by  1024  pixels),  can  fractal  techniques  be  used 
to  reduce  the  amount  of  memory  required  to  store  the  image?  The  compression 
ratio  is  the  quotient  of  the  raw  data  of  the  image  on  the  screen  to  the 
data  required  when  using  some  fractal  technique.  The  objective  is  to  make  the 
compression  ratio  as  large  as  possible. 
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Current  techniques  (nonfractal)  are  able  to  achieve  compression  ratios  as 
high  as  10  to  1.  Barnsley  has  achieved  ratios  of  15  to  1  for  perfect  repli¬ 
cation  of  the  image  and  as  high  as  1000  to  1  for  non-perfect  replications.  Even 
though  the  latter  are  non-perfect,  they  retain  the  fundamental  qualities  of  the 
picture,  and  look  rather  like  a  painted  (or  sketched)  copy  of  a  photograph. 

Barnsley  has  formed  his  own  company  to  exploit  his  techniques:  Iterated 
Systems,  Inc.,  named  after  the  process  used  to  store  and  regenerate  these 
images.  Iterated  Function  Systems  (IFS),  as  a  mathematical  topic,  will  be 
discussed  in  this  report. 


1.2  Intuitive  Dimension 


What  is  dimension?  Mathematics  students  might  say  that  it's  the  number 

of  basis  vectors  in  a  vector  space.  This  is  a  good  answer  if  the  question  is: 

What  is  the  dimension  of  a  vector  space? 

A  vector  space  is  an  abstract  structure  which  happens  to  be  used  a  great 

deal  to  model  different  settings  of  physical  phenomena.  For  example,  we 

3 

usually  imagine  ourselves  as  moving  around  in  R  ,  Euclidean  3-space.  Relativity 
is  modeled  using  a  curved  4-dimensional  vector  space  called  space-time.  But 
vector  spaces  are  used  almost  exclusively  to  model  some  section  of  the 
universe,  rarely  for  the  objects  within. 

Finding  a  dimension  is  intuitively  like  counting  "degrees  of  freedom."  How 
many  (seemingly)  independent  observations  are  possible?  We  might  say  that  colored 
pigment  is  3-dimensional  since  it  can  be  decomposed  into  red,  green,  and  blue. 
Sound  is  infinite  dimensional,  but  hearing  probably  isn't,  since  humans  cannot 
hear  the  whole  auditory  spectrum.  Taste  might  be  5-dimensional. 

These  examples  deal  with  Information.  How  much  information  is  the  key 
question  in  determining  dimensions  this  way.  However,  there  is  a  difference 
between  information  and  "shape".  We  will  define  a  shape  to  be  what's  left  when 
all  the  available  information  is  known.  Most  objects  are  a  combination  of  shape 
and  information. 

Basis  vectors  are  part  of  the  "where"  in  a  shape.  They  are  basis  vectors 
because  they  are  all  that  is  needed  to  convey  this  information.  So  counting  basis 
vectors  is  equivalent  to  finding  an  in/ormation  dimension. 
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We  will  use  historical  techniques  to  find  dimensions  of  objects  which  aren't 

vector  spaces.  It  should  come  as  a  relief  that  shape  and  Information  dimensions 

3 

will  agree  when  they  can  be  applied  to  the  same  object,  like  R  .  It  is 
unfortunate,  however,  that  only  information  dimension  seems  to  be  intuitive.  The 
definitions  we  will  use  for  "shape"  dimension  are  difficult. 


1.3  Observations  and  Representations 

Before  we  develop  methods  of  determining  the  dimension  of  shapes,  we  must 

distinguish  between  different  dimensions  used  to  represent  an  object.  We  will 

3 

use  3-dimensional  Euclidean  Space,  R  ,  to  model  the  three  directions  which 

2 

seem  to  surround  our  environment.  Two-dimensional  Euclidean  space,  R  ,  will  be 
used  to  model  a  sheet  of  paper  or  a  computer  screen. 

The  subjective  link  in  any  observation  is  the  human.  Our  vision  is 
influenced  by  imperfect  eyes  and  an  imperfect  brain.  But  essentially, 

3 

reflected  (or  transmitted)  light  from  an  object  in  R  is  imaged  (through  the 
iris  and  cornea)  onto  the  retina  at  the  back  of  the  eye.  Information  is  sent 
from  the  retina  via  the  optic  nerve  to  the  brain.  Because  the  retina  is  a  sur¬ 
face  (and  can  be  modeled  with  2  dimensions),  there  are  subtle  ways  in  which  the 
brain  interprets  a  3-dimensional  image  from  the  information  sent  by  the  eye. 

The  study  of  this  process  is  called  stereopsis. 

Perhaps  because  of  the  way  our  vision  works,  humans  are  able  to  interpret 

2 

3-dimensional  images  from  photographs  or  drawings  in  R  .  And  because  it  is 

easier  to  take  a  picture  than  build  a  model  (or  construct  a  hologram),  we 

2  3 

commonly  use  R  to  represent  images  from  R  . 

Definition:  A  set,  S,  is  imbedded  in  another  set,  T,  if  and  only  if  S  C  T. 

3 

For  example,  if  we  take  a  picture  of  a  ball  (imbedded  in  R  ),  the  photo- 

2 

graph  will  contain  a  shaded  disc  imbedded  in  R  .  The  area  of  the  shaded  disc 

2 

is  a  two-dimensional  subset  of  R  .  The  shading  cues  our  eyes  to  see  curvature 
which  is  not  present  in  the  photograph. 

Definition:  We  will  say  an  n-d imensional  object,  E,  is  flat , 
imbedded  in  Rn;  i.e.,  E  C  Rn. 


if  E  can  be 


Thus,  a  line  is  flat  (straight),  since  it  is  one  dimensional  and  can  be 
imagined  to  lie  in  R  (the  number  line) — it  is  the  whole  set  in  this  case.  A 

shaded  disc,  (filled  in  circle),  is  flat  since  it  is  two-dimensional  but  fits 

2  3 

in  R  .  A  solid  box  is  flat,  since  it  is  three-dimensional  and  a  subset  of  R  . 

A  triangle  is  not  flat.  Neither  is  a  circle.  Both  curves  cannot  be  im¬ 
bedded  in  R  even  though  they  are  1-dimensional.  These  curves  can  be  imbedded 
2 

in  R  .  However,  a  helix  (a  curve  in  the  shape  of  a  spring)  cannot  even  be 

2  3 

imbedded  in  R  .  It  is  still  1 -dimensional ,  but  must  be  imbedded  in  R  .  Fortu- 

3 

ately,  all  1-dimensional  objects  (curves)  may  be  imbedded  in  R  . 

A  surface  is  a  2-dimensional  object.  A  sphere  (the  surface  of  a  ball)  is 

3 

curved  but  can  be  imbedded  in  R  .  An  eggshell  is  also  not  flat.  (A  sphere 

2 

cannot  be  imbedded  in  R  .)  But  there  are  surfaces,  like  the  Klein  Bottle, 

3  4 

which  cannot  be  imbedded  in  R  and  must  be  imbedded  in  R  .  The  situation  with 
"curved”  space  (3-dimensional  objects)  is  even  worse.  By  definition,  we  cannot 

3 

"see"  any  curved  space  since  we  can  only  see  objects  imbedded  in  R  .  One  can 
Imagine  that  R  is  not  even  enough  to  imbed  all  curved  3-dimensional  spaces,  so 
the  space-time  model  (which  is  curved  4-diraensional  space)  must  live  in  a  very 
high  dimensional  Rn. 

The  point  of  this  discussion  is  to  be  able  to  recognize  the  dimension  of 
the  object  as  being  (possibly)  different  from  the  space  in  which  it  is 
imbedded,  and  to  realize  that  visual  cues  (or  tricks)  are  necessary  to 

2 

represent  curved  2-dimensional  objects  (and  some  l-dimensional  objects)  in  R  , 
(a  picture). 

Exercises: 

1.  What  is  the  dimension  of  a  pencil?  Is  it  flat?  What  is  the  (approximate) 
dimension  of  the  surface  of  a  pencil?  Is  it  flat? 
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2.  A  torus  can  be  constructed  by  taking  a  finite  circular  cylinder  and  joining 
the  two  ends  to  make  a  shape  like  an  inner  tube.  What  is  the  dimension  of 

the  torus?  What  is  the  smallest  dimensional  Euclidean  space  into  which  it  can 
be  imbedded? 

3.  A  Klein  Bottle  is  constructed  like  a  torus,  except  the  two  ends  are  not 

joined  in  the  natural  way.  Instead,  they  are  attached  so  that  the  cylinder  is 

3 

on  the  same  side  of  the  join.  Is  this  possible  in  R  ?  What  is  the  dimension 
of  the  Klein  Bottle? 

4.  Suppose  you  take  a  picture  (of  the  surface)  of  a  pyramid.  In  the  photo¬ 
graph,  what  dimension  is  the  surface  of  the  pyramid?  Is  it  flat?  What  is  the 
dimension  of  the  surface  of  the  actual  pyramid?  Is  it  flat? 
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1.4  Topology  and  Open  Covers 

The  objective  of  part  1  is  to  Introduce  the  reader  to  fractional  dimension. 
But  first,  we  need  to  introduce  "topological  dimension"  as  a  base.  The  topolo¬ 
gical  dimenision -will  not  be  fractional,  but  some  ideas  from  its  development  are 
extrapolated  in  the  formulation  of  Hausdorff  dimension,  which  is  fractional. 

Topology  is  the  study  of  shape  without  distance.  Because  it  is  so  abstract, 
many  shapes  which  we  perceive  as  different  are  lumped  together  by  topology.  For 
example,  the  surface  of  a  cube,  a  sphere,  and  the  surface  of  a  football  are  all 
the  sane.  Similarly,  a  semi-circle  and  a  line  segment  are  equated  in  topology. 

So,  most  of  the  aspects  of  curvature  are  ignored  by  topology.  For  this 
reason,  a  topological  definition  of  dimension  is  very  useful.  To  use  topology, 
it  is  not  necessary  to  throw  away  our  familiar  mathematical  structures  (distance, 
arithmetic,  etc.).  The  ideas  of  topology  are  just  incorporated  into  one's 
setting.  These  ideas  are  formulated  using  open  sets: 

Definition:  Let  T  be  a  set  and  ft  a  collection  of  subsets  of  T.  (T,  ft)  is  called 
a  topological  space  (with  topology  ft)  if  and  only  if: 

(i)  ♦  e  ft  and  T  e  ft;  ($  is  the  empty  set). 

(ii)  If  G  eft  for  each  a  e  I  (I  is  any  index  set),  then  U  G  e  ft. 

a  oel  a 

n 

(iii)  If  G.  eft  for  i  -  1,  ...»  n,  then  f|  e  ft. 

1  i-1  1 

A  topological  space,  T,  is  a  set  together  with  a  topology  on  that  set. 

F.lements  of  the  topology  are  subsets  of  T.  They  are  called  open  sets.  To  be  a 

topology,  three  criteria  must  be  satisfied:  (i)  the  empty  set  and  T  itself  must 

be  open;  (ii)  any  union  of  open  sets  must  still  be  open;  and  (iii)  any  finite 

intersection  of  open  sets  must  still  be  open. 

2  3 

We  will  work  in  familiar  spaces,  like  R  and  R  ,  and  define  a  topology  on 
them.  This  will  make  topological  dimensions  accessible  in  our  settings. 


9 


Examples: 


1.  (R,  Clj  )  is  a  topological  space  where  R  is  the  real  line  and  a  subset  of  R  is 
in  Slj  (the  topology)  if  and  only  if  it  can  be  written  as  a  (possibly)  infinite 
union  of  open  intervals.  We  throw  in  the  empty  set  to  be  complete. 

Thus,  each  open  interval  (including  R)  is  itself  an  open  set.  Because  two 

open  intervals  must  intersect  in  an  open  interval  or  an  empty  set  (both  of  which 

are  open),  criterion  iii  is  satisfied.  Criterion  ii  is  satisfied  by  definition. 

The  open  intervals  are  called  a  basis  for  the  topology  since  any  open  set 

is  a  union  of  these  basis  sets.  (They  act  like  components.) 

2 

2.  (R  ,  )  is  a  topological  space  where  ( \ ^  is  formed  from  the  basis  consisting 

2 

of  all  open  discs  in  R  .  (An  open  disc  is  the  area  inside  a  circle,  without  the 
circle  itself.)  Therefore,  open  sets  in  are  unions  of  open  discs.  It  is  a 
little  harder  to  verify  that  finite  intersections  of  open  sets  are  still  open. 

3.  (R  ,  )  is  a  topological  space  when  consists  of  open  sets  formed  from  the 

basis  of  open  balls  (the  interiors  of  spheres). 

Remark:  In  examples  2  and  3  above,  it  is  possible  to  change  the  basis  without 
changing  the  topology.  See  the  exercises. 

Definition:  A  set,  F,  in  a  topological  space,  T,  is  called  closed  if  and  only  if 

c 

the  complement  of  F,  denoted  F  ,  is  open. 


Theorem:  If  (T,  D)  is  a  topological  space  then: 

(i)  Both  $  and  T  are  closed; 

(ii)  if  Fa  is  closed  for  each  a  e  I  (I  is  any  index  set), 
is  closed  and 


then  fl 
a  el 


n 

(iii)  if  F^  is  closed  for  i  *  1,  ...,  n,  then  y  is  closed. 

i-1 


F 


a 
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The  proof  of  the  theorem  relies  on  the  definition  of  closed  as  the  (set) 
complement  of  open  and  is  left  for  the  exercises. 

2  3 

When  one  is  working  in  a  metric  space,  like  R,  R  ,  or  R  ,  there  is  a  natural 
topology  induced  by  the  metric.  The  topologies  in  examples  1  through  3  are 
induced  by  the  Euclidean  metrics.  For  this  reason,  limit  points  and  interior 
points  are  other  ways  to  characterize  closed  and  open  sets. 

Definitions :  Let  (R  ,  d)  be  Euclidean  n-space  with  the  usual  metric,  d: 
d[(xp  ...,  xn),  (y1 . y^)]  - 

Let  A  CI_  R  and  Xq  e  R  .  Then  Xq  is  an  interior  point  of  A  if  and  only  if  there 

is  an  e  >  0  so  that  if  d(x,  x^  )  <  e  then  x  e  A.  Also,  xQ  is  a  limit  point  of  A 

if  and  only  if  for  every  e  >  0  there  is  an  x  *  Xg  so  that  x  e  A  and  d(x,  xQ)  <  e. 

Theorem:  In  examples  1  through  3,  a  set,  A,  is  open  if  and  only  if  each  element 
of  A  is  an  interior  point  of  A.  Also,  a  set,  B,  is  closed  if  and  only  if  B 
contains  all  of  it6  limit  points. 

The  proof  is  left  for  the  exercises. 

In  topology,  open  sets  have  a  connotation  of  being  large.  (In  a  metric 
space,  every  point  of  an  open  set  is  an  interior  point;  so  open  sets  cover  a  lot 

of  area.)  One  way  to  measure  the  size  of  an  arbitrary  set,  is  to  find  the 

"smallest”  open  set  which  contains  it. 

Definition:  Let  (T,  fl)  be  a  topological  space,  and  suppose  A  (Z  T.  Then  IJ  is  an 
open  cover  of  A  if  and  only  if  U  e  fl  and  A  C  u. 

There  are  usually  (infinitely)  many  open  covers  for  the  same  set.  In  sub¬ 
sequent  sections,  we  will  find  ways  of  measuring  the  "smallest"  such  cover.  This 
is  part  of  the  subject  called  measure  theory. 
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Example  4 


There  is  no  "smallest"  open  cover  of  a  single  point,  e  R,  since  any 
interval  of  the  form  (x^  -  e,  x^  +  e  )  is  an  open  cover  of  {x^}  (e  >  0). 

But,  the  "smallest"  open  cover  of  any  open  set  is  that  set  itself. 

We  will  end  this  section  with  another  definition  of  "large". 

Definition.  In  a  topological  space  (T,  £5),  a  subset  A  C  T  is  dense  in  T  if  and 
only  if  for  each  U  is  £2,  U  f)  A  *  $. 


Exercises : 

1.  Let  X  be  a  nonempty  set  and  P(X)  be  the  power  set  of  X.  So  P(X)  contains  all 
subsets  of  X.  Show  that  (X,P(X))  is  a  topological  space.  Which  subsets  of  X  are 
closed? 

2.  Tn  R,  let  (a,  b]  *  {x  e  R:  a  <  x  <  b)  be  a  hslf-open  interval.  Define  a  new 
topology  on  R  by:  a  set  is  open  if  and  only  if  it  ran  be  written  as  the  union  of 
half-open  intervals  (always  closed  on  the  right),  or  is  the  empty  set.  Show  that 
an  open  interval,  (u,  v)  ■  (x:  u  <  x  <  v},  is  an  open  set  in  this  new  topology. 
Thus,  the  new  topology  contains  the  usual  copology.  Is  (a,  b]  open  in  the  usual 
topology?  The  new  topology  is  f iner  than  the  usual  topology;  or  the  usual 
topology  is  coarser  than  the  new  topology. 

3.  Using  the  definition  of  closed  in  a  topological  space,  (T,  £1)... 

a.  Show  that  $  and  T  are  closed. 

b.  Show  that  if  F  is  closed  for  cel,  then  0  1  e  fl. 

a  el 

n 


c.  Show  that  if  F  is  closed  for  i  -  1,  ...,  n,  then  U  F  is  closed. 
1  i-1  1 


Hint: 


u  *  Y  *  n  and  f  n  a 

oel  °7  oel  \ael 


U  A<i  . 
ael 
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4.  The  Euclidean  metric  on  R  is  given  by  absolute  value: 

d(x,  y)  ■  jx  -  yj . 

Show  that  every  point  of  an  open  interval  is  an  interior  point  of  that  interval; 
thus,  open  sets  are  the  same  metrically  and  topologically  (with  the  usual 
topology). 

2 

5.  Same  as  4.  with  R  . 

3 

6.  Same  as  4.  with  R  . 

7.  Show  that  if  a  set  doesn't  contain  all  of  its  limit  points,  then  it's  not 
closed  by  showing  that  the  missing  limit  point  cannot  be  an  interior  point  of  the 
complement  of  the  set.  Hence,  the  complement  of  the  set  isn't  open.  Work  in  Rn 
with  the  Euclidean  metric. 

6.  Show  that  if  a  set  isn't  closed  (so  that  it's  complement  isn't  open)  then 
there  is  a  point  in  the  complement  which  isn't  an  interior  point  of  the  compli¬ 
ment,  but  must  be  a  limit  point  of  the  set.  Hence,  the  set  doesn't  contain  all 
of  its  limit  points.  Work  in  Rn. 

9.  It  is  often  possible  to  find  a  different  basis  for  a  topological  space  which 
will  give  the  same  topology: 

2 

a.  Show  that  the  basis  of  open  squares  (the  interior  only)  in  R  will  also 
generate  the  usual  topology.  Is  there  a  metric  which  corresponds  to  this  basis? 

b.  Show  that  the  basis  of  open  cubes  (the  interior  only)  in  R  will  also 
generate  the  usual  topology. 

10.  Show  that  a  single  point  is  a  closed  set  in  R  .  Hence,  any  finite  subset 
of  Rn  is  also  closed. 

11.  Let  Q  denote  the  rational  numbers.  Is  Q  a  closed  subset  of  R?  Is  it  open? 
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12.  In  Rn  with  the  Euclidean  metric  and  usual  induced  topology,  open  n-balls 
can  be  used  as  the  basis  of  the  topology.  (An  open  1-ball  is  an  open  interval, 
etc.)  Show  that  an  open  set  (which  is  a  union  of  open  n-balls)  cannot  be  the 
uncountable  union  of  disjoint  open  n-balls.  (Hint:  Use  the  fact  that  there 
are  countably  many  points  whose  coordinates  are  all  rational.) 

13.  Let  {r^}  be  an  enumeration  of  all  the  rational  numbers  in  R.  Find  an  open 
cover  of  (rn)  30  that  the  sum  of  the  lengths  of  all  the  component  intervals  is 
less  than  1. 

(Hint:  Let  each  be  the  midpcint  of  an  interval  of  length  —  ) 

Thus,  this  open  cover  is  "large"  in  two  senses:  it's  open  and  dense.  But  it's 
"small"  in  the  sense  that  it  has  a  short  length  compared  to  all  of  R. 
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1.5  topological  Dimension 

2  3 

We  will  be  Interested  In  calculating  the  dimension  of  objects  in  R  and  R  • 
An  important  fact  is  that  subsets  of  a  topological  space  are  also  topological 
spaces  with  the  "relative  topology." 

Definition:  Let  (T,  fl)  be  a  topological  space,  and  S  C  T.  Define  the  relative 
topology  on  S  to  be  -  {U’:  there  is  a  U  e  8  with  U’  ■  SHU}. 

It  is  easy  to  show  chat  (S,  ft’)  is  a  topological  space.  The  open  sets  in  S 
are  just  intersections  of  open  sets  in  T  with  S  Itself. 

Example  1: 

2 

Find  the  relative  topology  on  a  circle  Imbedded  in  R  . 

2 

Since  an  open  set  in  R  is  a  union  of  open  discs,  the  relative  topology  on  S 
consists  of  open  sets  which  are  the  union  of  open  arcs. 

The  following  definition  is  due  to  Henri  Lebesque  (1875-1941).  We  have 
adapted  it  to  subsets  of  R°. 

Definition:  Let  X  be  Imbedded  in  R°,  for  some  n.  The  topological  dimension  (or 

Lebesque  dimension  or  covering  dimension)  of  X  is  less  than  or  equal  to  m,  i.e., 

dim  X  <  m,  if  and  only  if  for  any  finite  collection  of  p  open  sets,  G^,  (rela- 

P 

tively  open  in  X)  with  Xs  (j  G  ,  there  is  another  collection  of  p  open  sets, 

i-1  1 

P 

H  ,  so  that  each  H  C  G  ,  X  ■  1 1  H  ,  and  any  m  +  2  of  the  H  have  no  point  in 
i  i  1  i-i  1  1 

common.  And,  if  dim  X  >  m  -  1,  then  dim  X  ■  m. 

Essentially,  the  above  definition  finds  the  most  efficient  open  covers  (in 
terms  of  overlap)  of  a  set,  X.  The  topological  dimension  is  related  to  that 
efficiency. 
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Example  2; 


A  single  point  has  topological  dimension  zero. 

Suppose  xQ  e  R.  The  only  open  sets  in  {x^}  are  4  and  { Xq }  itself.  So  if  C^, 

.  .  P 

i  -  1,  ...,  p,  are  any  open  sets  so  that  ^x  }  -  G  ,  then  at  least  one  of  the 

i-1  1 

G^  must  be  {x^}  itself,  call  it  (without  loss  of  generality),  G^.  Then  define 

*  «  p 

Hj  «  Gj,  and  =  ...  “  -  $.  Thus,  {x^J  »  y  ,  but  any  two  of  the  have 

an  empty  intersection.  Therefore,  dim  { }  _<  0.  Also,  the  only  set  with  dimen¬ 
sion  -1  is  the  empty  set.  (Since  each  open  set  in  the  cover  must  be  empty.)  So 
we  can  conclude  that  dim  { Xq }  -  0. 

Remarks :  In  our  definition  of  topological  dimension,  we  do  not  specify  which  Rn 

the  set  X  is  imbedded  in.  In  example  2  we  imbedded  a  point  in  R,  but  we  could 

2  3 

have  imbedded  it  in  R  ,  R  ,  etc.  The  topological  dimension  will  be  invariant 
(with  respect  to  the  imbedding  space)  since  the  usual  topology  of  Rn  is  also  the 
relative  topology  on  Rn  if  Rm  is  imbedded  in  Rn  where  n  >  m.  See  the  exercises. 

Example  3. 

The  dimension  of  any  line  segment  (finite  or  infinite)  is  one. 

Let  S  be  a  line  segment.  We  imbed  S  as  an  interval  (open,  closed,  or 

half-open)  in  P.  The  proof  will  proceed  by  induction  on  the  number  of  open  sets 

(in  S)  which  cover  S: 

1 

If  S  «  (J  G  then  we  can  choose  IT.  -  G.  and  we're  through. 

i-1  p  P 

Assume  that  when  S  -  y  G.  there  exists  open  H.  jZ  G,  so  that  S  •  U  H 

i-1  1  11  i-1 

and  no  3  of  the  have  a  point  in  common. 

p+1 

Now  suppose  *5  “  (J  where  p  M.  For  i-1,  ...,p-l  define  G^  -  G^. 

We  proceed  through  four  cases  based  on  the  relationship  of  G^  to 
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Case  1:  G'  H  G'  .  =  <i. 

P  P+1 

P 

Then  let  G  ■  G'  II  C'  Now,  S  *  |l  G.  so  there  are  open  H  Cl  C  so  that 
P  P  U  P+1  i  1—1 

P 

S  *  (j  H  and  no  3  of  the  H  have  a  point  in  common.  Define  H'  -  H  for  1=1, 
1=1  1  1  1 

...»  p  -  1  and  let  H"  -  G’  0  H  and  H*  ,  =  G’  H  H  .  Since  G'  M  C'  =  +,  we 

P  P  P  P+1  P+1  P  P  1  1  P+1 

P+1 

also  have  IT  f)  H*p+i  “  So  ®ach  is  open,  Hj  CT_  Gj,  S  =  {J  H’,  and  no  3  of 
the  have  a  nonempty  intersection,  completing  the  proof  in  this  case. 


Case  2:  G'  C  G’. 

p+1  —  p 

As  above,  let  G  *  G1  U  G'.  ■  G'.  Then,  we  can  obtain  H,  CZ  G, .  Redefine 

P  P  P+1  P  i  —  i 

for  i  =  1,  ...,  p  and  let  As  before,  the  open  C_  G^, 

p+1 

S  =  U  »  and  no  ^  of  the  H!  have  a  nonempty  intersection  (since  the  11  ,'s 
i-1  1  1 

didn't),  completing  the  proof  in  this  case. 

Case  3:  G'  C  G’  . 

P  —  P+1 

This  case  is  the  same  as  case  2  with  p  replaced  by  p  +  1  and  visa  versa. 


Case  4:  Not  case  2  or  3,  but  G^  f)  ^p+j  * 

Again,  we  let  Gp  *  Gp  U  Gp+j  an<*  a^n  open  Hj,  ...,  H^.  Now,  let 

for  i  =  1,  ...,  p  -  1  and  define  H"  -  H  H  C'.  Also,  define  H"  =  H  H  G* ... 

v  P  P  P  P+1  P  P+1 

Since  Hp'+j  1®  a  union  of  disjoint  open  intervals,  we  will  remove  any  interval  from 

11"  ,  which  is  a  subset  of  H"  and  any  interval  from  H"  which  is  a  subset  of  H"  . , 
p+1  p  1  P  P+1 

forming  new  sets,  H*  .and  H' ,  which  are  still  open.  We  now  have  open  H'  Cl  c' 

p+1  p  l  —  l 

p+1 

so  that  S  =  y  H' .  Since  no  three  of  the  H  have  a  nonempty  intersection,  if  3  of 
i-1  1 

the  Hj  have  a  point  in  common,  then  and  HP+1  must  be  two  of  those  sets. 

(Also,  no  4  of  the  HJ  can  have  a  nonempty  intersection.)  Suppose  1  _<  k  <  p 
and  ()  H^fi  Hp+1  *  Then,  this  nonempty  intersection  must  be  mimicked  among 
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their  open  (component)  interval(s).  Let  1^  CZ 
i  *  k,  p,  and  p  +  1.  Because  of  the  way  +  ^ 

I  ,,  (f  I  .  We  have  three  cases: 

p+1  —  p 


be  such  component  intervals  for 
was  constructed,  I  4  1  and 

p  p+1 


Case  a:  I  II  1  T,  •  In  this  case,  we  may  redefine  H'  and  H’  .  to  be 

p  w  p+l  —  k  p  p+1 

H"  -  I  and  H*  -  I  .  respectively.  The  sets  are  still  open,  and  the  union  of 
P  P  P+1  P+l 

the  H^'s  still  cover  S. 


Case  b:  I,  C  I  h  I  ...  In  this  case  we  can  redefine  H,'  as  H'  -  I,  . 

k  —  p^  p+1  k  k  k 

Case  c:  Not  case  b  or  c.  Then  since  1  Pi  I  , ,  t  4.  I  ill  ,  is  an  interval 

p  p+1  p1-1  p+1 

and  1^  must  overlap  either  the  right  or  left  side.  Redefine  I  so  that  it  still 

overlaps  but  does  not  go  so  far  as  to  also  overlap  I  f|I  , Then  the  new  H,'  will 

p  p+l  k 

use  this  new  I,  . 

k 

Case  a,  b,  and  c  may  be  applied  to  any  of  the  component  intervals  which 
behave  in  that  way.  After  such  applications,  we  obtain  open  H|  so  that 

P  +  l 

S  ■  (J  H'  ant)  no  ^  of  the  H'  have  a  nonempty  intersection.  This  completes  the 
i-1  1 

proof  by  induction  and  establishes  that  dim  S  _<  1.  Suppose  S  is  covered  by  2 
overlapping  open  intervals,  Gj  and  Gj.  Then,  in  order  to  still  cover  S,  and 
must  also  be  overlapping.  Thus,  dim  S  ^  0.  So,  din  S  ■  1. 


In  particular,  example  3  shows  that  the  topological  dimension  of  R  (an 
infinite  line  segment)  is  one.  So  topological  dimension,  which  is  capable  of 
measuring  nany  shapes,  agrees  with  the  vector  space  dimension  of  R,  which  measures 
information. 

The  following  facts  are  presented  without  proof: 


ift 


Theorem:  Let  dim  denote  topological  dimension. 

(i)  dim  Rn  -  n. 

(ii)  If  Xj ,  X^,  ...  is  a  countable  collection  of  closed  sets  (each  imbedded  in 

00 

the  same  Rn  for  some  n)  then  dim  (  y  X  )  -  max  {dim  X  ] 

i-1  i 

(iii)  If  X  M  then  dim  (X  x  Y)  <_  dim  X  +  dim  Y. 

(iv)  If  dim  X  ■  n,  then  X  can  be  written  as  the  union  of  n  +  1 

O-dimensional  subsets  of  X. 

Exercises : 

1.  What  is  the  topological  dimension  of  the  rational  numbers,  0? 

2.  What  is  the  topological  dimension  of  the  irrational  numbers,  R  -  Q? 

3.  What  is  the  topological  dimension  of  Q  x  Q?  This  is  the  set  of  all  ordered 

pairs  where  both  coordinates  are  rational.  What  is  the  dimension  of  (R  -Q)  x  (R  -Q)? 
A.  A  topological  space,  T,  is  called  disconnected  if  and  only  if  T  can  be  written 

as  the  disjoint  union  of  two  nonempty  open  subsets.  The  space,  T,  is  totally  dis¬ 

connected  if  every  subset  of  T  consisting  of  more  than  one  point  is  disconnected 
(using  the  relative  topology).  The  space,  T,  is  connected  if  it  is  not 
disconnected.  Is  R  connected,  disconnected,  or  totally  disconnected?  How  about  Q 
and  R  -  Q? 

2 

5.  Let  S  be  a  finite  rectangle  in  R  .  Cover  S  with  3  open  discs  which  overlap  in 
the  center  of  S.  Is  it  possible  to  find  3  sub-discs  which  cover  S  but  have  an 
empty  intersection?  What  is  the  dimension  of  S? 

6.  What  is  the  dimension  of  the  surface  of  a  cube?  Since  the  surface  of  a  cube 
and  a  sphere  are  topologically  equivalent,  what  is  the  dimension  of  a  sphere? 
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1.6  Hausdorff  Dimension — A  Definition  of  Fractal 

Hausdorff  Dimension  was  the  first  logically  developed  tool  which  could 
give  a  non-integer  result  to  be  interpreted  as  the  dimension  of  some  shape. 
With  the  advent  of  recent  computer  graphics,  it  can  be  seen  that  this  dimen¬ 
sion  is  useful.  The  human  eye  is  capable  of  distinguishing  between  similar 
shapes  with  different  Hausdorff  dimensions.  However,  Hausdorff  dimension  Is 
mathematically  difficult  to  work  with.  To  start,  we  will  discuss  some  ideas 
from  measure  theory. 

Lebesque  (outer)  measure  is  a  way  to  define  the  "length"  of  abstract 
sets.  Essentially,  one  finds  the  most  efficient  open  cover  of  the  set,  and 
then  finds  the  length  of  that  open  set  by  adding  the  lengths  of  the  intervals. 
We'll  restrict  ourselves  to  R  for  the  time  being. 

Definitions.  Let  I  be  an  open  interval  in  R.  So  I  -  (a,b)  for  some  a  and  b. 

The  length  of  I  is  b  -  a,  and  is  denoted  by  |l|. 

Let  F,  be  a  subset  of  R.  The  Lebesque  outer  measure  of  E  is  denoted  by 

E)  and^(E)  »  inf  l  |l  |  where  U  I  is  an  open  set  of  disjoint  component 
n  n 

intervals,  1^,  and  the  infimum  Is  taken  over  all  open  sets  which  cover  E. 
Example  1. 

The  Lebesque  measure  of  a  single  point  is  zero. 

Without  loss  of  generality,  assume  the  point  is  zero  as  a  subset  of  R. 
Then,  for  any  e  >  0  we  can  find  an  open  interval,  and  hence  an  open  set,  which 
covers  zero  and  has  length  less  than  e.  This  implies  (since  e  is  arbitrary) 
that  the  infimum  over  all  covers  is  zero,  proving  the  claim. 
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(A  measure,  like  Lebesque  measure,  is  always  defined  on  a  large  class  of 
sets  which  form  a  "o-algebra. "  If  one  assumes  the  "Axiom  of  Choice",  then  it 
can  be  shown  that  there  are  subsets  of  R  which  are  not  Lebesque  measurable; 
although  every  subset  is  Lebesque  outer-measureable. ) 

For  this  report,  we  will  assume  that  the  sets  we  encounter  are  always 
measureable.  The  following  are  presented  without  proof: 

Theorem. 

Let  ^denote  Lebesque  measure.  Then: 

(i)  If  (£)  “  0  then  every  subset  of  E  is  measureable  and  has  measure 

zero. 

(li)  If  Ej ,  E2,  E^,  ...  is  any  countable  collection  of  disjoint  measure- 
able  sets,  then 

Some  Immediate  consequences  of  this  theorem  are  that  the  measure  of  any 
interval,  (open,  closed,  or  half-open),  is  computed  by  subtracting  the  left 
endpoint  from  the  right;  and  that  the  Lebesque  measure  of  the  rational  numbers 
(or  any  countable  set)  is  zero. 

The  idea  behind  Lebesque  measure  will  now  be  generalized  to  get  Hausdorff 
(outer)  measure.  Instead  of  adding  the  lengths  of  all  the  intervals  in  the 
cover,  we  add  a  power  of  the  lengths  of  all  the  intervals  in  the  cover. 

Definitions. 

Let  «  >  0  and  s  >  0.  If  E  is  a  subset  of  R,  then  the  Hausdorff  s-dliaen- 
s tonal  6-pre-measure  of  E  is: 

H®(E)  -  inf  I  {If8 

0  n  n 


21 


where  the  I  's  are  open  component  intervals  of  a  cover  of  E  and  each  1 1  |  is 
n  n 

less  than  6.  The  infimum  is  taken  over  all  open  covers  of  order  6  (that  is, 

each  |l  |  <  6). 

1  n' 

The  Hausdorff  s-dlmenslonal  (outer)  measure  of  E  is 

HS(E)  -  lim  H®(E). 

6+0  6 

Needless  to  say,  this  is  a  very  technical  definition.  However,  it  is 

easy  to  generalize  to  higher  dimensions.  (That  is,  Rm  Instead  of  R. )  One 

just  defines  to  be  the  (maximum)  diameter  of  an  open  set  in  Rm. 

The  6's  in  the  definition  are  needed  for  obscure  reasons.  Basically, 
s  s 

H.,(E)  is  larger  than  H»(E)  if  6'  <  6.  Thus,  the  covers  are  less  efficient  as 
6  0 

their  maximum  size  decreases. 

The  s  in  the  definition  is  the  power  to  which  each  f I  I  is  raised.  It 
will  be  directly  related  to  the  dimension  of  the  set,  E.  Since  s  is  only 
restricted  to  be  positive,  non-integer  dimensions  will  be  possible. 

Example  2. 

Let  E  be  a  line  segment  of  length  one.  He  can  assume  E  ■  (0,1)  in  R. 

The  Hausdorff  s-dimensional  measure  of  E  will  be’ 

a.  infinite  if  s  <  1, 

b.  one  if  s  ■  1,  and 

c.  zero  if  s  >  l. 

To  start,  note  that  if  9  *  i  trcn  ‘ausdorff  1-dimensional  measure  is  the 
same  as  Lebesque  measure.  So,  we  need  only  concern  ourselves  with  parts  a 
and  c. 


2? 


Part  a.  Let  s  <  1. 


Choose  a  large  M  >  0.  We'll  show  that  there  Is  a  aaall  6  so  that  H8(E)  >  M, 

and  that  as  M  gets  larger,  5  gets  smaller.  This  will  Imply  that  llm  H,(E)  ■  «, 

6+0 

completing  the  proof  of  this  part. 

1-a  1 

So,  we  choose  a  large  integer,  k,  such  that  k  >  M  and  then  let  6  -  — . 

(Since  s  <  1,  as  M  increases  so  will  k,  and  hence  6  will  get  smaller — approaching 

zero.)  The  most  efficient  cover  of  order  6  (of  E)  will  be  less  efficient  than 

k  open  Intervals,  each  of  length  6  »  i.  So, 

H®(E)  >  l  (i)8  >  !({[)-  M. 

n"l  n“l 

This  shows  that  the  Hausdorff  s-dimenslonal  measure  of  E  is  infinite  when  s  <  1. 
Part  c.  Let  s  >  1. 

Choose  a  small  number  e  >  0.  We'll  show  that  there  is  a  small  6  so  that 

g 

Hg(E)  <  e,  and  that  as  e  gets  smaller,  so  does  6.  This  will  imply  that 

HS  "«<*>  * 

1-8  1 

Let  e  >  0,  and  choose  a  large  integer  k  so  that  k  <  e,  and  6  *  — .  (Since 
s  >  1,  as  e  decreases,  6  will  decrease  as  well.)  The  most  efficient  cover  of 
order  6  will  be  approximately  as  efficient  as  k  intervals  of  length  i.  Thus, 

■>;«>  -  \  £>•  <  I  (?)  ■ 

n-1  n“l 

This  shows  that  the  Hausdorff  s-dimensional  measure  of  E  is  zero  when  s  >  1, 
completing  the  proof. 

Example  2  displays  the  type  of  behavior  that  Hausdorff  s-dimensional  measure 
always  exhibits.  For  subsets  of  R,  when  •  >  1  the  measure  will  be  zero,  and  when 
s  ■  1  the  measure  will  agree  with  Lebesque  measure.  If  the  Lebesque  measure  is 
positive,  then  for  smaller  values  of  s,  the  Hausdorff  s-dlmensonal  measure  will 
always  be  infinite.  (This  can  happen  even  if  the  Lebseque  measure  is  zero— see 
section  1.8.) 
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These  qualities  are  used  to  define  Hausdorff  dimension: 

Definitions. 

Let  E  be  a  subset  of  R.  The  Hausdorff  dimension  of  E  is  the  infimum  of 
the  set  of  s  such  that  the  Hausdorff  s-dimensional  measure  of  E  is  zero. 

This  definition  is  extended  to  Rm  by  using  the  diameter  of  1  instead 

"  n 

of  the  length  of  I  .  So,  |l  |  -  sup  {d(x,y):  x,y  e  I  }  where  "d"  denotes  distance 
,  n  n  n 

in  Rm,  and  I  is  now  any  open  set.  Then  the  Hausdorff  dimension  of  subsets 
n 

of  Rm  is  the  same  as  that  above. 

Example  2  shows  that  the  Hausdorff  dimension  of  the  open  interval  (0,1)  is 
one.  This  agrees  with  both  intuition  and  topological  dimension.  In  fact,  the 
Hausdorff  dimension  of  a  point  (and  any  countable  set)  is  zero  (also  in  agreement), 
and  the  Hausdorff  dimension  of  Rn  is  n.  This  leads  us  to  a  definition  of  "fractal." 

Definition.  A  subset,  E,  of  Rn  is  a  fractal  if  the  topological  dimension  of  E 
is  different  than  the  Hausdorff  dimension  of  E. 

The  first  fractal  we  will  encounter  will  be  the  "Cantor  Set"  in  section 
1.8.  But,  since  Hausdorff  dimension  is  hard  to  work  with,  we'll  define  a 
"similarity  dimension"  in  the  next  section.  This  similarity  dimension  will  be 
easy  to  calculate  on  special  sets,  and  will  agree  with  the  Hausdorff  dimension  on 
such  sets. 

Exercises 

1.  Show  that  the  Hausdorff  dimension  of  a  single  point  is  zero. 

2.  What  is  the  Lebesque  measure  of  the  irrational  numbers  between  zero  and  one? 

3.  What  is  the  Hausdorff  dimension  of  the  irrational  numbers  between  zero  and 
one? 

4.  Is  the  set  of  Irrational  numbers  between  zero  and  one  a  fractal? 

5.  What  is  the  Hausdorff  dimension  of  E  *  {(x,y):  0  _<  x,y  _<  1}? 
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1.7  Similarity  Dimension 

Similarity  dimension  is  an  easier  tool  for  measuring  the  (Hausdorff) 
dimension  of  special  sets.  These  sets  are  "self-similar".  We  will  use  the 
following  definition  for  now: 

Definitions. 

For  the  following  recursive  procedure,  N  is  a  positive  integer  and  r  is 
a  real  number,  0  <  r  <  1. 

(i)  Start  with  a  generating  set.  Eq,  with  one  component. 

(ii)  Given  E  ,  with  Nn  components,  form  E  by  replacing  each  component 
n  n+l 

of  by  N  new  components  so  that  the  diameter  of  each  new  component  is  r 
times  the  diameter  of  the  old  component.  E^+^  will  have  Nn+*  components. 

If  this  recursive  process  has  a  limit  set,  E,  which  uniquely  depends  upon 
the  choices  for  N  and  r,  then  E  will  be  called  a  self-similar  set. 

The  tern,  "component",  used  above,  is  intentionally  vague.  But,  whatever 
is  meant  by  component  in  part  (i)  is  to  be  used  in  part  (ii)  as  well.  "Com¬ 
ponent"  could  be  replaced  by  "shape".  Note  that  there  is  no  restriction  on 
n 

the  R'  in  which  this  process  takes  place. 

For  example,  E^,  could  be  a  line  segment.  Then,  each  line  segment  would 
be  replaced  by  N  new  line  segments,  r  times  the  size.  Or,  one  could  use 
triangles,  spheres,  pyramids,  helices,  etc. 

We'll  now  motivate  the  formula  used  in  similarity  dimension.  It  is 

equivalent  to  Hausdorff  dimension  for  self-similar  sets... 

In  the  recursive  process,  E^  could  be  covered  by  N  open  sets,  each  of 

diameter  r.  (We  assume  that  the  diameter  of  Eq  is  1.)  Then,  if  6  >  r, 

2  2 

H^(Ej)  “  N(r)8.  Note  that  for  E2,  the  diameters  are  r  ,  but  there  are  N 
components,  so  H8^)  “  (Nr8)^,  and  In  general,  H8(En)  -  (NrS)n.  Now,  as  6 
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goes  to  zero,  we  have  n  going  to  infinity,  (so  that  r11  is  less  than  <5),  but 

g 

this  will  not  give  a  nonzero  or  noninfinite  limit  unless  Nr  ■  1.  However, 
we're  looking  for  this  value  of  s,  say  Sq .  When  s  is  bigger  than  s^,  the 
Hausdorff  s-dimensional  measure  will  be  zero,  and  when  s  is  less  than  s^, 
the  Hausdorff  s-dimensional  measure  is  infinite.  So,  s^  is  the  Hausdorff 


dimension  of  E  and  satisfies  Nr  ®  =  1.  (Or,  s 


log! 


0  log(l/r ) * 


Note:  E  is 


imbedded  in  R  ,  for  some  m,  so  can  never  be  greater  than  m. ) 


Definition.  The  similarity  dimension  of  a  self-similar  set,  E,  is  - — . 
-  - 1 -  log( l/r) 

where  N  and  r  are  as  defined  in  the  recursive  process.  This  is  also  the 
Hausdorff  dimension.  The  formula  fails  if  it  generates  a  dimension  larger 
than  that  of  the  space  in  which  E  is  imbedded. 


Exercises . 

1.  Define  a  point  as  follows:  Start  with  a  line  segment,  and  replace  any 
line  segment  by  a  smaller  (subset)  line  segment  one-half  the  size.  Then  N  -  1 
and  r  “  y.  What  is  the  dimension  of  a  single  point.  Is  a  point  uniquely 
defined  in  terms  of  N  and  r? 

2.  Restricting  N  as  a  positive  integer  and  r  as  a  real  number,  0  <  r  <  1, 

1  ogN 

what  is  the  range  of  the  function:  s(N,r)  ”  i0g(l /r)? 

3.  Suppose  you  observe  a  coastline  from  orbit.  You  digitize  a  picture  of  it 
and  count  a  total  of  10n  pixels  on  the  coastline  between  two  fixed  points. 

The  100  pixels  given  an  approximate  length  of  100  kws ,  You  are  now  in  an  air¬ 
plane  over  the  same  coastline  and  notice  a  new  digitized  image  has  twice  the 
resolution.  After  counting  pixels  on  the  coastline  you  now  get  an  approxi¬ 
mate  coastline  length  (between  the  same  points)  of  121  kms.  Finally,  with  a 
good  map  with  twice  the  previous  resolution  you  approximate  the  length  to  be 
146  kms.  What  approximate  dimension  would  model  this  coast’ne’’ 
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1.8  The  Cantor  Set 


This  will  fce  the  first  section  which  is  dedicated  to  applying  our  tools 
to  examples  of  fractals.  The  Cantor  Set  is  one  of  the  most  famous  "weird" 
sets  in  all  of  mathematics.  It  was  originally  developed  by  Georg  Cantor 
(1845-1918)  to  show  properties  of  cardinality:  that  it  is  possible  for  a 
"small"  set  to  be  "uncountable".  We  will  give  three  equivalent  formulations 
of  this  set. 

Formulation  1.  (Self-similarity.)  Let  EQ  be  the  closed  interval,  [0,1],  in  R. 
Choose  N  -  2  and  r  -  j.  Given  a  line  segment  (component)  in  E^,  remove  the 
middle  (open)  j  and  replace  the  segment  with  the  2  closeu  end-segments  of 
length  y  times  the  original: 


Formulation  2.  (Closed  Set.)  From  the  interval  [0,1]  in  R,  remove  the  open 
Interval  which  is  the  middle  one-third.  For  each  closed  interval  remaining 
repeat  this  process  ad  infinitum. 

Formulation  3.  (Tertiary  numbers.)  All  real  numbers  may  be  written  in  a  base 
3  expansion  using  the  digits  0,  l,  and  2.  This  expansion  is  unique,  up  to 
repeating  2's  which  are  equivalent  to  a  1  followed  by  repeating  zeros.  (This 
is  analogous  to  .99  -  1.0.)  The  Cantor  Set  is  the  collection  of  all  real 
numbers  between  zero  and  one  (inclusive)  which  can  be  written  in  base  3  using 
only  the  digits  0  and  2.  (So  .1  (base  3)  is  in  the  Cantor  Set  since 
.1  (base  3)  *  .02  (base  3).) 

It  isn't  too  hard  to  see  that  formulations  1  and  2  give  the  same  set. 

But  It  is  rather  remarkable  that  formulation  3  is  also  the  same  set! 
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From  formulation  1,  we  can  calculate  the  Hausdorff  dimension  (similarlity 
dimension)  of  the  Cantor  Set  to  be  log(2)/log(3).  This  is  a  noninteger  number, 
so  it  cannot  agree  with  the  topological  dimension.  This  shows  that  the  Cantor 
Set  is  a  fractal. 


Definition.  A  subset,  E,  of  a  topological  space,  T,  is  nowhere  dense  if  and 
only  if  for  every  open  set,  II,  in  T,  there  is  an  open  subset  of  U  which  does 
not  intersect  E^ . 


Theorem. 

(i) 

(ii) 

(iii) 

(iv) 

(v) 


Let  C  denote  the  Cantor  Set. 

The  topological  dimension  of  C  is  zero. 

The  Lebesque  measure  of  C  is  zero. 

C  is  an  uncountable  set. 

C  is  a  closed  set,  with  no  isolated  points. 
C  is  nowhere  dense. 


Proofs. 


(i)  C  is  a  totally  disconnected  set  hv  construction.  Let  Gj  , . . . ,  G  be 
n  P 

open  sets  so  that  (J  C  covers  C.  Then  we  can  choose  open  subsets  H  C_  C. 

1=1  1  11 
which  cover  C  and  are  at  most  abutting.  Thai  is,  the  H^'s  do  not  overlap. 

Thus,  the  topological  dimension  of  C  is  zero. 

(iO  The  corrnlement  of  r  inside  (D,ll  is  an  open  set.  We'll  denote  it 

by  P.  We'll  find  the  Lebesque  measure  of  p  by  adding  the  lengths  of  all  its 

intervals : 


cX  (P)  -  j 

i  “I 


,1-1 


since  at  the  ith  level  of  construction,  one  removes  2  intervals,  each  of 

(1 


length  (l)1.  Thus, 


i  “1 
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Since  Pj  has  measure  one  inside  [0,1]  and  C  »  Pc,  (C)  -  0. 

(iii)  We'll  prove  this  part  by  using  formulation  3.  The  tertiary  numbers 
between  0  and  1  which  only  contain  the  digits  0  and  2  are  in  1  -  1  corres¬ 
pondence  with  the  binary  numbers  between  0  and  1.  Since  there  are  uncountablv 
many  (binary)  numbers  between  0  and  1,  C  is  also  uncountable. 

(iv)  C  is  a  closed  set  since  its  complement,  P,  is  open.  Also,  the  end¬ 
points  of  the  intervals  which  were  removed  from  C  are  elements  of  C.  These 

V 

endpoint6  form  a  countable  subset  of  C,  but  they  are  dense  in  C;  i.e.,  each 
point  of  C  is  a  limit  point  of  the  endpoints. 

(v)  Given  any  open  set,  U,  in  [0,1],  there  is  an  open  interval  in  P  which 
is  completely  contained  in  U.  Since  P  fl  C  •*  $,  C  must  be  nowhere  dense. 

Thus,  C  is  a  perfect  (closed  with  no  isolated  points),  null  (zero  Lebesque 
measure),  nowhere  dense  fractal  with  Hausdorff  dimension  equal  to  log(2)/log(3>. 

It  is  easy  to  construct  Cantor-type  sets  by  removing  the  middle  p, 

(0  <  p  <  !),  instead  of  the  middle  one-third,  of  each  remaining  interval.  The 
resulting  set  will  share  most  properties  of  the  Cantor  set,  except  its  Hausdorff 
dimension  and  self-similarity. 

In  fact,  it  is  possible  to  construct  a  Cantor-type  set  which  has  zero 
Hausdorff  dimension.  This  means  its  topological  and  Hausdorff  dimension 
agree,  so  it  is  not  a  fractal.  This  points  out  a  serious  flaw  in  the 
definition  of  "fractal."  A  more  general  definition  will  be  given  later. 
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Exercises . 


1.  Form  a  Cantor-type  set  by  removing  the  middle  p,  (0  <  p  <  1),  of 

each  remaining  interval  instead  of  the  middle  one-third.  What  is  its  Hausdorff 
dimension?  For  0  <  p  <  1,  what  is  the  range  of  values  for  this  dimension. 

2.  Given  any  open  set,  U,  in  R,  what  is  the  Hausdorff  dimension  of  U?  What  is 
the  Hausdorff  dimension  of  the  complement  of  any  Cantor-type  set? 

3.  If  you  divide  an  interval  into  4  pieces  and  remove  the  second  one,  then 
repeat  this  process  ad  infinitum,  you  obtain  another  self-similar  closed  set. 

In  general,  let  N  =  n  -  1  and  r  ■  For  such  self-similar  sets,  state  an 
analogous  theorem  to  that  for  the  Cantor  set.  (Include  this  set's  Hausdorff 
dimension.)  If  you  replace  N-n-lbyN=n-m,  what  values  of  m  make 
sense?  What  is  the  range  of  achievable  Hausdorff  dimensions? 

2 

4.  In  R  ,  divide  a  square  into  9  subsquares  and  remove  the  middle  one.  Will 
this  recursive  process  generate  a  fractal?  What  is  its  Hausdorff  dimension. 
(Remember  to  use  diameter  lengths  when  calculating  r.) 

5.  In  R  ,  divide  a  cube  into  27  subcubes.  At  each  step,  (level  of  recursive 
process),  remove  7  of  these  subcubes.  Is  the  Hausdorff  dimension  effected  by 
which  7  are  removed?  Could  one  remove  a  different  (or  random)  7  at  each  level? 
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1.9  Koch  Snowflakes 


Some  of  the  first  "monster  curves"  or  "snowflakes"  were  constructed  by 
Helge  von  Koch.  We  will  look  at  a  few  examples  of  self-similar  shapes  in  these 
categories: 

Example  i. 

Let  the  generating  set,  Eq,  be  a  line  segment.  Use  N  *  4  and  r  ■  -j  in  the 
following  manner: 

Whenever  you  encounter  a  line  segment,  replace  it  by  four  line  segments  in 
the  above  formation.  The  dimension  of  the  resulting  "curve"  is  log  4/log  3 
which  is  larger  than  1. 

At  the  nttl  stage,  the  length  of  is  4n(i)n  (y)n.  This  quantity 
approaches  infinity  as  n  approaches  infinity,  so  the  curve  must  have  infinite 
length.  On  the  other  hand,  the  entire  curve  will  fit  inside  a  bounded  square. 
This  is  not  a  contradiction;  for  example,  if  we  tried  to  compute  the 
l-dlmen8lonal  length  of  a  2-dimensional  square,  we  would  get  an  infinite 
answer. 

The  Hausdorff  s-dimensional  measure  is  exactly  the  tool  necessary  to 
compute  "lengths"  (or  measures)  of  s-dimensional  shapes.  It  is  necessary  to 
adapt  the  measurement  to  the  dimension  of  the  shape  you  are  measuring.  The 
measurement  could  still  be  infinite,  or  zero,  but  it  would  have  more  meaning: 
Just  as  it  means  more  to  say  that  a  line  segment  is  2  units  long  rather  than  it 
has  zero  area. 
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Unfortunately,  It  is  difficult  to  calculate  the  Hausdorff  s-dimenaional 

measure  of  a  shape  (where  s  is  the  shape's  dimension).  This  measurement  is  also 

2 

dependent  on  the  type  of  sets  one  allows  in  the  cover.  For  example,  in  R  ,  if 
we  only  allow  open  discs,  we  will  get  a  different  measurement  than  when  wee 
allow  any  open  sets  to  be  used.  this  reason,  we  note  that  such  measurements 

exist  and  have  meaning,  but  won't  be  used  in  this  report. 

Example  2. 

The  generating  set,  Eg,  will  be  the  same  as  in  Example  1,  but  N  »  2  and 

r  ■  —  .  The  process  is: 

/3 

-  - > 

The  self-similar  shape  resulting  from  this  recursive  process  has  dimension 
log  2/log  /3  =  log  4/log  3,  so  the  dimensions  of  Examples  1  and  2  are  the  same 

(in  fact,  they  are  more  directly  related  than  that — see  the  exercises). 

Since  in  both  of  the  examples  above  each  shape  is  connected  (not 

2 

disconnected)  and  lies  in  R  ,  their  topological  dimensions  are  at  least  one.  It 
is  a  bit  harder  to  show  that  their  topological  dimensions  are  actually  equal  to 
one.  But  for  any  shape,  E,  the  topological  dimension  of  E  is  always  less  than 
or  equal  to  the  Hausdorff  dimension  of  E.  Regardless,  the  shapes  in  examples  1 
and  2  are  fractal  curves. 

Example  3. 

The  generator,  Eg ,  will  still  be  a  line  segment.  Now,  N  -  3  and  r  ■  y. 


The  process  is: 


/3 


The  height,  h,  is  jr  times  the  length  of  the  segment  on  the  left.  Thus,  if  E 
has  length  1,  the  farthest  displaced  point  from  in  the  limit  set,  E,  will  be 
I  (  4"  )  "  — 13 -  units  away.  The  Hausdorff  dimension  of  this  fractal  curve 


is  log  3/log  2. 
Exercises. 


1 


1.  In  example  2,  if  r  ■  —  ,  the  Hausdorff  dimension  of  the  resulting  set  is  2. 

^  2  1 
This  is  an  area  filling  curve.  If  this  process  is  done  in  R  and  —  <  r  <  1, 

/? 

does  the  predicted  Hausdorff  dimension  make  sense? 

2.  As  in  example  2,  let  N  -  2  and  r  -  —  .  Each  time  the  process  is  done,  flip 

/I 

a  coin  to  determine  whether  the  triangle  will  displace  up  or  down.  Does  the 
dimension  change  from  that  of  example  2?  Give  a  rough  sketch  of  a  resulting  E. 

3.  For  N  -  3  and  a  fixed  r,  -^  <  r  <  —  ,  there  are  more  degrees  of  freedom  in 

3  /3 

a  random  process  than  there  were  in  exercise  2.  Explain. 

4.  If  we  take  example  1  and  apply  it  to  the  3  sides  of  an  equilateral  triangle, 
we  get  a  "snowflake".  What  is  its  dimension?  Does  this  change  if  we  apply  it 
to  Che  sides  of  a  square? 

3  1 

5.  Let  Eq  be  a  square  imbedded  in  R  .  Define  N  •  13  and  r  *  -j  as  follows: 


What  Is  the  Hausdorff  dimension  of  E? 

6.  Exercise  5  may  be  applied  to  the  6  sides  of  a  cube.  What  shape  does  it 
resemble? 

7.  Show  that  a  countably  infinite  set  of  points  on  the  curves  generated  in 
examples  1  and  2  are  the  same. 
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I. 10  Random  Coastlines 


Exercise  3  In  section  1.9  contains  an  Idea  we  can  use  to  generate  random 
fractal  curves  of  any  specified  dimension  between  one  and  two.  Since 
self-similarity  does  not  require  that  the  same  scheme  be  used  at  each  level  of 
the  recursive  process,  (only  N  and  r  need  be  fixed),  we  can  randomly  change  the 
scheme  to  obtain  a  random  fractal  curve. 

If  N  *  3  and  4-  <  r  <  —  ,  by  specifying  r,  it  is  possible  to  achieve 

"  i 

any  dimension  between  one  and  two.  In  example  3  of  section  1.9,  r  B  j  80  the 

resulting  dimension  was  log  3/log  2.  If  you  want  the  dimension  to  be  d, 

then  choose  r  “  N  where  N  *  3. 

Since  we  want  our  curve  to  be  connected,  at  each  stage  we  join  3  segments 
where  there  was  only  one.  These  segments  have  fixed  length,  it 


max  0 


i  X 


old  segment 

*  '  '  jJ 


In  the  above 
maximum  arc  about 


diagram,  we  can  place  the  first  segment  anywhere  within  the 
the  left  endpoint.  (See  the  exercises.) 


Once  this  segment  has  been  placed,  there  are  exactly  2  choices  for  the 
placement  of  the  second  segment  (unless  the  first  was  at  _+  max  0,  in  which  case 
there  is  only  one  choice).  The  placement  of  the  third  segment  is  determined. 


So,  this  algorithm  requires  a  random  number  between  -max  9  and  max  0  for 
placement  of  the  first  segment;  and  a  coin  toss  (0,1  random  variable)  for  place¬ 
ment  of  the  second  segment  which  also  determines  placement  of  the  third  segment. 
The  continuous  random  variable  in  the  process  allows  for  greater  variability 
than  a  single  coin  toss  at  each  step  (which  is  what  happens  if  M  ■  2). 

The  four  pages  of  figures  which  follow  make  it  clear  that  this  process  can 
be  used  to  model  coastlines.  At  first  glance,  this  fact  seems  to  be  of  little 
use.  However,  the  fact  is  useful  from  a  "first-principles"  point  of  view, 
leading  us  to  believe  that  coastlines  are  self-similar  objects.  Thus,  any  valid 
geological  theory  on  the  evolution  of  coast-lines  would  need  to  address  some 
similarity  at  different  scales. 


EM 

gSbry, 

avLwMLP 

It  » 

■^1% 

Figure  2 


"The  nine  frames  in  this  figure  depict  random  coastlines 
generated  with  an  algorithm  based  on  exercise  2  in  sec¬ 
tion  1.9.  The  ratio,  r,  is  varied  so  that  dimensions  of 
1.1,  1.2,  ...,  1.9  are  realized.  For  each  picture,  the 
probability  of  displacing  up  is  1/2.  2949  points  are 

graphed  per  frame.  We  ca..  sis  the  higher  dimension 
fractals  are  area  filling. 
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I 
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Figure  3 


"In  each  row  of  this  figure,  dimensions  are  1.01,  1.05, 
and  1.1  (from  left  to  right).  The  same  algorithm  was 
used  as  in  figure  2,  but  now  the  probabilities  of 
curving  down  are  .5,  .7,  and  .9  for  the  top  through 
bottom  row,  respectively.  1025  points  were  plotted 
in  each  figure." 


Figure  4 


"Each  random  fractal  in  this  figure-  has  dimension  1.1.  The 
probabilities  of  curving  down  vary  from  .1  to  .9." 

"On  the  following  page:  All  18  frames  in  figure  5  use  the  3 
segment  algorithm  developed  in  this  section.  In  the  first  3 
rows,  a  uniform  distribution  is  used  for  the  angle  of  the 
first  segment  and  .5  is  used  for  the  ne::t  two  segments  (just 
like  a  2-segment  algorithm.'  rhe  last  3  rows  all  depict  a 
dimension  of  l.i.  The  last  2  rows  use  a  truncated  normal 
distribution  with  small  and  large  standard  deviation 
(respectively)  ard  probabilities  of  .1  and  .9, 
respectively  for  the  last  2  segments." 
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Unfortunately,  the  algorithm  described  in  this  section  is  not  too  useful 
outside  of  graphic  simulation.  A  much  more  applicable  idea  would  be  to  use 
self -similarity  in  order  to  decrease  the  amount  of  data  required  to  depict  an 
actual  geographic  object.  That  is,  given  a  mountain,  is  it  possible  to  generate 
an  accurate  image  of  this  mountain  without  using  the  millions  of  bits  of 
information  contained  in  a  high  resolution  photograph?  If  it  were,  then  the 
image  could  be  transmitted  to  another  person  (or  machine)  in  a  fraction  of  the 
usual  time. 

Exercises. 

1.  Given  N  *  3  and  fixed  r,  with  <  r  <  ^  ,  what  is  the  value  of  max  9  as 

J  /3 

described  earlier  in  this  section? 

2.  If  the  first  segment  makes  an  angle  of  max  9  with  the  left  endpoint  of  the 
old  segment,  what  angle  will  the  third  segment  make  with  the  right  endpoint? 

Note  that  this  value  was  used  as  the  standard  deviation  of  the  (truncated) 
normal  distribution  in  some  of  the  figures  ir.  this  section. 

3.  Construct  an  algorithm  similar  to  the  one  in  this  section,  but  use  N  *  4. 
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I. 11  Another  Approach  -  IFS 


The  definition  of  a  self-similar  set  given  In  1.7  is  neither  exact  nor 
formal.  It  Is  useful  from  an  intuitive  point  of  view,  but  not  too  useful 
mathematically.  In  this  section  we  will  develop  the  framework  necessary  to 
study  Iterated  Function  Systems  (IFS). 

The  paper  "Fractals  and  Self-Similarity"  by  John  Hutchinson  gives  a 
complete  discussion  of  the  ideas  behind  IFS.  Michael  Barnsley  coined  the  term 
IFS  and  has  exploited  the  mathematics  for  applications  for  DARPA,  AFOSR,  and  his 
own  company,  Iterated  Systems,  Inc. 

Three  topics  will  be  introduced  in  this  section:  "compact  sets",  "the 
Hausdorff  metric",  and  "contraction  maps".  It  will  help  to  use  the  following 
relations: 

a.  Compact  sets  will  be  pictures,  images,  or  real  shapes. 

b.  The  Hausdorff  metric  will  measure  how  close  two  compact  sets 
(pictures)  are  to  being  the  same. 

c.  Contraction  maps  will  act  as  lenses  which  focus  any  starting  image 
into  a  determined  compact  set  (picture) — sort  of  like  a  kaleidoscope. 

In  practice,  the  contraction  maps  will  be  repeatedly  applied  to  any 
generating  set  (image).  Each  application  will  bring  a  new  image  which  is  closer 
to  the  limiting  image  (compact  set).  This  process  can  be  used  to  generate 
fractals  like  those  we  have  seen  earlier,  or  extremely  detailed  pictures  of 
nature,  including  human  faces.  (The  less  self-similar  seeming  the  picture,  the 
greater  number  of  contraction  maps  are  necessary  to  generate  it.) 

We  will  start  with  the  idea  of  a  compact  set. 
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Pef lnitlon.  Let  (T,  SI)  be  a  topological  space 


.  A  subset  of  T,  F,  is  compact  if 

and  only  if  for  all  collections  (A  :  a  e  T,  A  e  £l|  such  that  (J  A  ID  F, 

1  a  a  '  T  a  — 

a  el 

there  is  a  finite  subcollection  {A  :  i  ■  1,  ....  n,  a.  e  i)  such  that 

i  ' 

,n,  A  ID  F  also. 

U  a,  — 

i-1 

In  words,  a  set  is  compact  if  and  only  if  given  an  arbitrary  open  cover, 
there  is  a  finite  subcover. 

Example  1.  A  point  is  compact. 

Let  0  e  R.  If  there  is  an  arbitrary  collection  of  open  sets  in  R  which 
cover  {0},  then  at  least  one  of  those  sets  must  actually  contain  0.  This  set  is  a 
finite  subcover,  so  {0}  is  compact. 

Example  2.  An  open  Interval  is  not  compact. 

Let  (0,1)  be  a  subset  of  R.  We  will  construct  an  open  cover  of  (0,1)  which 
has  no  finite  subcover: 

OB 

Define  C  *  (—  l).  Then  11  G  -  (0,1)  90  { 0  ]  is  an  open  cover  of  (0,1)* 

n  vn  J  ,  n  1  n’ 

n*l 

If  there  were  a  finite  subcover  from  {G  },  then  .here  would  be  a  maximum  index, 

n 

say  N,  in  that  subcover.  But  -  (—,  l),  and  since  no  <ndex  in  the  subcover  is 

larger  than  N,  the  points  between  0  and  ^  are  rot  covered  bv  this  finite 

N 

collection.  Thus,  there  is  ro  finite  subcover  and  (0,1)  is  not  compact. 

Pef lnlt ton •  A  subset,  B,  of  Rn  is  bounded  if  and  only  if  sup  (d(x,0):  x  C  B}  is 
finite  where  d  is  F.jci  i dean  distance.  T>at  Is,  ?.  is  bounded  if  and  only  if  B 
will  fit  inside  some  n-ball  of  finite  radius. 

We  will  state  the  following  useful  theorem  without  proof: 

Theorem.  A  subset  of  Rn  is  corapac-  if  and  only  if  it  is  closed  and  bounded. 
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Example  3.  The  Cantor  Set  Is  compact  since  it  is  closed  and  bounded  in  R. 


Example  4.  All  the  fractal  curves  generated  in  section  1.10  are  compact,  since 
they  are  also  closed  and  bounded. 

Example  5.  Any  image  on  a  monitor  is  compact  since  it  consists  of  a  finite 
number  of  points  (pixels). 

Example  6.  Any  observable  shape  of  matter  is  compact.  (One  would  need  to  be 
careful  with  particle/wave  duality  at  a  very  small  scale.) 

The  next  two  topics  require  a  review  of  metric  spaces. 

Oef lnltlon.  If  S  is  a  set  and  d:  S  x  S  ♦  R,  then  (S,d)  is  a  metric  space  if  and 

only  if  the  following  conditions  are  satisfied: 

(i)  for  all  x, y  e  S,  d(x,y)  _>  0  and  d(x,y)  -  0  if  and  only  if  x  “  y. 

(ii)  for  all  x, y  c  S,  d(x,y)  *  d(y,x). 

(iii)  for  all  x,y,z  e  S,  d(x,z)  j<  d(x,y)  +  d(y,z). 

Remarks.  A  metric  space  abstracts  the  idea  of  distance,  embodied  in  the 
function,  d.  The  first  two  requirements  are  straightforward;  the  third 
requirement  says  that  it's  always  shorter  to  go  from  one  point  directly  to 
another.  Also,  every  metric  space  generates  a  natural  topology  in  the  following 
manner: 

A  point,  x,  i 8  an  interior  point  of  (a  subset  of  the  metric  space),  if 
and  only  if  there  is  an  e  >  0  so  that  i *  ,  '  <  e  then  y  e  A.  With  this 

definition,  a  set  is  open  if  and  only  '  •  t  its  elements  is  an  interior 

point . 

This  development  shows  that  a  top  ■  ■  ■<  space  is  more  abstract  than  a 
metric  space  since  every  metric  space  i  topological  space,  but  not  vice 


versa. 


-u 


Example  7.  (Rn,d)  Is  a  metric  space  where  d  f (x  ^ xn)>(yj»  •••»  yn)  ) 

1 1/2 


-  i  K-yJ2 

Li-l 


This  Euclidean  metric,  d,  generates  the  usual  topology  on  R  .  (Note 
n  =  1,  2 ,  3. . . ) 


We  are  now  in  a  position  to  define  the  Hausdorff  metric. 

Definition.  Let  n  be  a  fixed  natural  number,  and  S  =  {F  (Z  Rn:  F  is  compact 
and  nonempty}. 

If  x  is  any  point  in  Rn  and  A  _CI  Rn,  extend  the  usual  Euclidean  metric  to 
d(x,A)  =  inf  (d(x,y):  y  e  A}.  So,  d(x,A)  measures  the  closest  distance  between 
the  point  and  the  set.  Now  extend  d  to  A  and  B,  (subsets  of  Rn),  as  d(A,B)  is 
the  maximum  of  sup{d(x,B):  x  e  A)  and  sup(d(y,A):  y  e  B}. 

d  is  the  Hausdorff  metric. 

We  need  to  show  that  (S,d)  is  a  metric  space. 


Theorem.  (S,d),  described  above,  is  a  metric  space. 

Proof .  Fix  n  e  N  and  let  A,  B,  and  C  be  compact  sets  in  Rn ,  and  thus  elements 
of  S. 

(i)  d (A , B)  >  0  since  the  Euclidean  metric  is  nonnegative,  d  is  finite 
valued  since  both  A  and  B  are  bounded  sets.  Assume  A  =  B.  Then,  for  ail  x  c  A, 
d  (x,  B)  »  0.  Thus,  sup  (d(x,  B) :  x  e  A}  «  0.  Similarv,  sup{d(y,A):  y  e  B]  =*  0. 
Therefore,  d(A,B)  ■*  f).  Nov  assume  d(A,B)  *  0.  Then,  sup{d(x,B):  x  c  A}  «  0, 
implying  that  each  d(x,B)  c  0,  since  they're  all  nonnegacive.  Thus,  inffd(x.y): 
y  e  B}  -  0  for  each  x.  This  implies  that  x  is  a  limit  point  of  B.  Since  B  is 
closed,  x  r.  B  for  each  x  e  A,  implying  A  C_  B.  Similarly,  B  C_  A ,  which  shows 
that  A  =  B  and  completes  part  (i)  of  the  definition  of  a  metric  space. 
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(ii)  By  definition, 


d(A,B) 


max 


max 


{sup  d(x,B),  sup  d(y,A} 
XCA  y £B 

{sup  d(y,A),  sup  d(x,B)} 
ye6  xea 


-  d(B,A) 

(ili)  sup  d(z,A)  *  sup  inf  d(x,z). 
zee  zee  xeA 


Since  B  is  a  closed  set,  there  is  a  y  for  which  d(y  ,z)  » 

z  z 

•  d(z,B).  Thus,  sup  d(z,A)  <  sup  inf  [d(x,y  )  +  d(y  ,z)  ] 
zee  zee  xeA  2  2 

■  sup  inf  [d(x,y  )  +  d(z,B)l 
zee  xeA  2 

-  sup  [inf  d(x,y  )  +  d(z,B)l 

zeC  xeA  2 

-  sup  [d(yz,A)  +  d(z,B)  ] 

*  d(yz.A)  +  sug  d(z,B) 

<  sup  d(y,A)  +  sup  d(z,B). 
yeB  zeC 

By  an  exactly  similar  argument, 


inf  d(y,z) 
yeB 


sup  d(x,C)  sup  d(y,C)  +  sup  d(x,B). 

xeA  yeB  xeA 


Therefore, 

d(A,C)  -  max  {sup  d(x,C),  sup  d(z,A)} 
xcA  zeC 

<  max  {sup  d(y,C)  +  sup  d(x,B),  sup  d(y,A)  +  sup  d(z,B)} 
yeB  xeA  yeB  zeC 

£  max  {sup  d(y,C),  sup  d(z,B)}  +  max  {sup  d(x,B),  sup  d(y,A) f 
yeB  zeC  xeA  yeB 

■  d(B,C)  +  d(A,B) ,  completing  part  (iii)  and  showing  that  (S,d)  is  a 

metric  space. 
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Example  8.  In  R,  the  (Hausdorff)  distance  between  the  Cantor  Set  and  the  Interval 


[0,1]  is  y. 

Let  A  be  the  Cantor  Set  and  B  ■  [0,1].  Since  A  C_  B,  d(x,B)  ■  0  for  each 

x  e  A.  Thus,  sup  d(x,B)  -  0.  If  y  t  B  then  d(y,A)  >  0  when  y  4  A*  The  largest 
xeA 

1  2 

part  of  B  which  does  not  contain  points  of  A  is  the  interval  (y,  y) .  It  is  easy 

to  see  that  y  ■  y  is  the  point  in  B  which  is  farthest  from  any  point  in  A,  so 

d(j,  A)  =  Thus,  d(A,B)  -  . 

2  2  2 
Example  9.  In  R  ,  the  (Hausdorff)  distance  between  A  »  {(x,y):  x  +  y  _<  l}  and 

B  *  {(x,y):  y  =  0  and  -2  _<  x  _<  2}  is  1. 

It  is  easy  to  check  that  sup  d((x,y),A)  *  1.  Also,  sup  df(x,y),B)  «  1. 

B  A 

Thus,  d(A,B)  =  1. 


We  will  now  define  contraction  mappings. 


Definition.  If  f:  S  +  S  where  (S,d)  is  a  metric  space,  then  f  is  a  contraction 
mapping  if  and  only  if  there  is  a  real  constant,  r,  so  that  0  r  <  1,  and  for 
all  x,y  e  S,  d(f(x),  f(y))  jC  rd(x,y). 


Intuitively,  a  contraction  napping  decreases  the  distance  between  any  two 
points.  Consequently,  every  contraction  mapping  is  continuous,  and  every 
contraction  mapping  has  a  unique  "fixed  point."  That  is,  if  f  is  a  contraction 
mapping  on  S,  then  there  fs  a  unique  point,  x^ ,  so  that  f(::.j)  "  xq*  The  Pro°f8 
of  these  facts  are  left  for  the  exercises. 


Example  10.  If  f:  R  -*■  R  by 
Let  r  »  y.  Then,  for 
"  y|x  -  y |  *  rd( x,y ).  Zero 


f(x)  "  y,  then  f  is  a  contraction  map. 
any  x,y  e  R,  dff(x),  f(y))  -  |f(x)  -  f(y) 
is  the  fixed  point. 
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Then  f  is  a 


Example  11.  Define  f:  R^  ♦  by  f(x,y)  *  ^j-[/3x  -  y],  ^-[/3y  +  x]^. 

contraction  mapping  with  r  *  y,  and  fixed  point,  (0,0). 

2 

Let  (xj  »y j )  and  (x2,y2)  be  pointB  in  R  . 
d(f(Xj .yj).  f(x2,y2))  - 

“  d((i  [fi  X1  -  yj»  Y\  +  ^J).  (i  K3  x2  -  y2],  ■|'[/3  y2  +  x2])J 

”  /(it/3  <xi -  x2)  _  (^i  “  y2>]f  +  (i[/3  (yi  -  y2>  +  (xi  *  x2>])2 

*  j  /3(x!  "  x2)2  +  ~  y2>2  +  3<yi  ~  y2)2  +  (xi  -  x2)2 

“  J  |/xl  -  X2)2  +  (yt  -  y2)2 

-  J  d C (Xj ,  yj),  (x2,  y2 ) ). 

It  is  easy  to  see  that  zero  is  the  fixed  point.  This  function  rotates  a  point 
by  ~  radians,  counterclockwise  about  the  origin,  and  decreases  its  distance  from 
the  origin  by  y.  Thus,  repeated  applications  of  f  will  take  a  point  through  a 
spiral  trajectory  into  the  origin. 

Definitions.  Let  f, ,  ...»  f  be  contraction  maps  on  Rn.  Then  |f,:  i  *  1,  ...,  m} 
1  1  in  l 

is  called  an  iterated  function  system  (IFS). 

If  A  C  Rn,  then  f^(A)  *  {y  e  Rn:  there  is  an  x  e  Rn  and  f^fx)  *  y}  for  each 

i  -  1 . .  f°(A)  -  A  and  fJ+1(A)  -  fJf^A)). 

We  will  let  f  denote  the  collection  {f^:  i  ■  1 . m}  as  follows: 

m 

f (A)  -  U  MA>, 

i-1  1 

and  fk(A)  is  the  ktf>  iterate  of  f. 

The  following  fact  is  presented  without  proof: 
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m}  is  an  interated  function  system  of  contrac- 


Theorem.  If  f  =  { f ^ :  i  “  1,  •• 

tion  maps  on  Rn,  then  there  is  a  unique  compact  set,  F  Rn,  such  that  f(F)  m  F 

and  for  any  nonempty  set,  A  C  Rn,  lim  f°(A)  *  F  in  tha  Hausdorff  metric. 

n  +“ 

Example  12.  Let  f  =  {fpfj}  where  each  f^:  R  -*■  R  by  fj(x)  »  y,  f2(x)  “  (x+2)/3. 

Then,  the  fixed  point  of  f  is  the  Cantor  Set. 

First,  we'll  show  that  lim  fn([0,l])  “  C,  where  C  is  the  Cantor  Set: 

n 

f  (10,1])  ■  {y:  there  is  an  x  £  [0,1]  and  fj(x)  *  y}  ■  f0,yl. 

Also,  f2(  [0, 1]  )  «  [|,l]. 

Thus ,  f  (  [0, 1  ] )  =f1([0,l])(Jf2([0,l])  *  [0,-jl  U  [y , 1  1 «  We  can  see  that  this  is 
the  first  level  of  the  construction  of  C  in  section  1.8. 

Now,  we'll  calculate  f ^ ([0,1] )  •  f(f[0,l]): 

t,  ao.ii  u  f§,i  n  -  ro.  |iu 

f2([o,i|  U  (|,il)  - 

So,  f2(  [0, 1  ] )  =  |0,i]  U  f|,  -j]  0  [|,  ^1  u  [f.1  1*  In  general,  f,  will  take  an 

interval  and  move  both  the  endpoints  y  closer  to  the  origin.  f2  will  do  the 

2 

same  thing,  and  then  add  y  to  every  point  in  that  interval,  shifting  it  to  the 

2 

right  by  y.  One  should  be  able  to  see  that  this  is  equivalent  (when  repeated  ad 
Infinitum)  to  both  formulations  1  and  2  in  section  1.8.  Thus,  lim  f n( [0,1])  -  C. 

Let's  try  to  show  that  C  is  in  fact  a  fixed  point  of  f.  To  do  this,  we'll 
use  formulation  3  of  C  from  section  1.9: 

«  d 

C  -  {x:  x  »  7  —  where  d  =*  0  or  2). 

i  on  n 

n-1  3 
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Let  x  e  C.  Then, 


1««1 1 
3 


(tertiary  expansion  with  0's  and  2's) 


f.  (x)  «  ■=■  -  l  — rr  "  J  -  where  dn»  0. 

1  3  _n+l  '•  _n  0 

n“l  3  n«l  3 

Thus,  fj  takes  points  in  C  to  other  points  in  C. 

,  «  d  ,  , 

f  (x)  •  —  +  —  ■  V  - -  -f-  —  where  d  m  0 
3  *  3  L  +  3  .wnere  aQ  u, 

n“l  3 

oo  d 


£  — -  where  dp  “  2. 


n-1  3 

So,  f2  also  takes  points  in  C  to  the  other  points  in  C.  Thus,  C  is  a  fixed  (set) 
point  of  f. 


How  does  one  find  the  dimension  of  a  fixed  point  of  an  IFS?  We  know  the 
dimension  of  the  Cantor  Set  is  log  2/log  3,  but  in  general  the  functions  in  the 
IFS  must  hold  the  key. 


Definition.  The  ratio  of  a  contraction  map  on  Rn  is  the  infimum  of  all  r  for 
which  d(f(x),  f (y ) )  _<  rd(x,y)  still  holds  for  all  x,  y  e  Rn. 

Thus,  in  example  12,  the  ratios  of  fj  and  f2  are  both  -j. 

Fact.  Under  certain  conditions  on  the  IFS  Riven  by  f  •  { f^ :  i  »  1 . m},  if 

the  ratio  of  f  is  r^,  then  the  dimension  of  the  fixed  point  (set)  of  f  is  the 

n 

-  g 

unique  number  s  such  that  [  r,  *  1. 

i-1  1 

The  conditions  necessary  for  this  fact  are  too  technical  to  discuss.  But, 
among  other  things,  each  f  must  be  a  similitude  (preserves  shape,  but  not  size). 
Additionally,  there  cannot  be  too  much  overlap  in  a  construction  (following  the 
process  of  section  1.7). 
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Example  13.  Calculate  the  Hausdorff  dimension  of  the  Cantor  Set  by  using  the  fact 


on  the  previous  page. 

Since  rj  *  r2  -  y,  we  need  to  solve  (-I)8  +  (-j)8  -  1  for  s. 

2(-i-)8  *  1,  so  s  ■  log(l/2)/log(l/3),  implying  that  s  -  log  2/log  3. 

Exercises. 

1.  Prove  that  the  topology  generated  by  a  metric  space  really  is  a  topology. 

2.  Prove  that  the  general  Euclidean  metric  really  is  a  metric. 

3.  In  section  1.8,  let  E^  be  the  nth  set  in  the  recursive  process  which  generates 
the  Cantor  set  in  formulation  1.  (Alternately,  E^  is  the  nCh  iteration  of  f  on 
[0,11  in  example  12  of  this  section.)  Find  d(E^,  [0,1])  where  d  is  the  Hausdorff 
metric  on  compact  subsets  of  R. 

4.  Let  f  be  the  IFS  in  example  12.  Find  lim  fn  ([-1,0]). 

n  ■*■<*> 

2  2 

5.  Let  f  *  {fj,  f2,  f3}  where  each  fJ :  R  ♦  R  ,  is  given  in  polar  coordinates  by: 

f^r.e)  -(■§,«  +  £) 
f2(r,0)  -  (~ ,  0  +  ~) 
f3(r,0)  -  (-^,  0  -  £). 

Calculate  the  Hausdorff  dimension  of  the  fixed  point  of  f.  Find  f(A)  where 
A  »{(r,0):  r  1). 

6.  Prove  that  a  contraction  mapping  is  continuous  and  has  a  unique  fixed  point. 
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1.12  Further  Examples 

It  turns  out  that  many  useful  IFS  are  collections  of  ’’affine"  functions. 

Definition.  A  function,  f:  Rn  ♦  Rn,  is  affine  if  and  only  if  there  is  an  n  x  n 
matrix.  A,  and  a  n  x  1  vector,  b  so  that  if  x  e  Rn,  (x  is  n  x  1),  then 
f (x)  »  Ax  +  b. 

The  functions  in  the  IFS  must  still  be  contraction  maps,  but  affine 
functions  usually  suffice  to  fora  useful  pictures  (compact  fixed  sets). 


This  IFS  has  the  "Sierpinski  Triangle"  as  its  fixed  set  (point). 
(Figure  6,  page  57.) 


Remember  that  the  fixed  set,  P,  is  the  lim  f  (A),  where  A  is  any  nonempty 

n+*»  ' 

2 

subset  of  R  .  The  easiest  A  to  choose  would  be  the  set  containing  just  the 
origin; 


Then: 

^<A)  -  [\]  ,  f2(A)  -  [5J]  .  and  f3(A)  -  [”]. 
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So,  f<A)  -  ([{],  [5J], 

f2(A,  -  { (j1;!  J,  &5J. 

Implementing  this  algorithm  on  a  computer  is  memory  intensive.  It  is 

k  k+ 1 

necessary  to  store  f  (A),  reference  all  its  elements,  and  generate  f  (A).  To 

generate  a  picture  on  a  typical  computer  monitor  would  require  two  arrays,  each 

2 

capable  of  holding  640  x  350  bits.  And  this  is  only  for  functions  in  R  . 

Here  is  another  algorithm.  Unfortunately,  it  is  extremely  slow  and 
redundant,  but  it  does  require  minimal  memory. 

Theorem.  If  f  =  { f^ :  i  «*  1,  m}  is  an  IKS,  then  the  fixed  set  (point)  of  f,  P 

is  the  collection  of  all  fixed  points  of  all  finite  compositions  of  the  f^'s. 

Example  2.  Another  way  of  constructing  the  fixed  set  of  example  I. 

We  first  find  the  fixed  points  of  f ^ ,  f2»  and  f^.  (Note:  the  fixed 
point  of  Ax  +  b  is  (I  -  A)  *b  if  it  exists,  where  I  is  the  Identity  natrix.) 

The  fixed  point  of  fj  is: 

-  r°65  o?53r1  (!) 

-  to  ?][}]-  [*1. 

2  50 

Similary,  the  fixed  points  of  f^  and  f^  are:  [jqq]  and  [jqq]*  respectively. 
2  2  50 

So,  [2]*  fi00^’  an<J  f  1 00 1  are  points  in  the  fixed  set  of  f.  not  just  approximating 
points . 


[50  ]>• 


fie5)*  f 


1.5 

50.5 


i  r1,5i  r1J*3i  r3-3i  rZ3*3i  r 

J*  l  75  J*  1  75  J*  I50.5J’  1  75  J*  l75 


13.5 

75 


•25.5 
t50. 5 


r  25 . 5  - 

75 


37.5 


]}.  etc 
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The  theorem  says  we  need  all  fixed  points  of  all  compositions  of  the  f^'s. 

We  just  computed  fixed  points  of  compositions  of  order  1.  I.e,  f ^ ,  f2,  are 

themselves  trivial  compositions. 

Next  we'll  calculate  compositions  of  order  2: 

These  are: 

fl  *  fl  »  fl  °  f2  »  fl  °  f3  »  f2  “  fl  *  f2  #  f2  »  f2  *  f3  *  f3  *  fl 
f ^  a  f 2  ,  and  f ^  0  f 

Since  composition  of  functions  is  not  necessarily  commutative,  all  nine  need  to  be 
considered.  To  compose  two  affine  functions:  fj  ■  Ax  +  b  and  f2  *  Cx  +  d, 
ft  •  f 2 Cx )  -  A(Cx  +  d)  +  b 

■  ACx  +  Ad  +  b. 

In  our  example,  all  the  matrices  are  the  same,  so  each  matrix  of  the  order  2  com- 
25  0 

position  will  be  [*Q  ^ ] .  However,  there  are  nine  possibilities  for  the  vector 

part:  [*q  !?  ]d  +  b  where  d  and  b  can  be  [j  ],  [5g]»  °r  [50 1*  So*  we  get  vector 


parts  of 


r  1,5i 

l50.5  J* 


r 25.51 
l50.5  J’ 


r25.5 
L  75 


],  and  [3775  ]• 


We  need  to  calculate  the  9  fixed  points  of  these  9  compositions.  Since  each  com 
position  is  still  an  affine  map,  we  use  the  same  technique  as  on  the  order  1 
compositions  to  obtain  fixed  points: 


[*)•  134.7].  o.  I 

2  50 

Note  that  [2]  and  [1Q() 


67.3 


]. 


]  were  already  known. 


Even  though  we  calculated  3+9  fixed 


points,  we  only  have  10  distinct  points  in  our  fixed  set. 
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I 


Since  the  number  of  compositions  of  order  n  is  3,  and  there  is  much 
redundancy,  it  should  be  clear  that  this  algorithm  is  slow.  But,  at  least  it 
requires  minimal  memory,  (just  for  the  original  functions). 


2  «2 


Example  3.  Define  an  IFS  as  f  *  (f^  i  ■  1,  ...,  s}  where  f ^ :  IT  +  R 


f  (x)  “  A^x  +  b^  and 

rO  0, 


A  .  [°  °]  A  -  f85  0  , 

A1  l0  . 18 J  a2  [  0  .85  J  * 

.  _  [".85  0  1.  r.2  .2,  . 

A3  '  0  .85  j  ’  A4  1.2  .2  J  '  and 


.  T-.2  .21 

S  =  L  .2  . 2  ]  * 


S1  “  0  ’  s2  “  53  "  *  and  \  *  *5  *  O* 


This  IFS  will  generate  a  fern  branch  in  R  •  It  is  possible  to  modify  this 

3 

IFS  to  generate  a  (curved)  fern  branch  in  R  ••• 


r"o  o  <f| 

i  0  .18  0  , 

0  0  0 


.85  0  0 

0  .85  .1 

0  -.1  .85 


-.85  0  0 

0  .85  .1  ,  A, 

0  -.1  .85 


‘.2  .2  0 

.2  .2  0  ,  and 

0  0  .3 


f-.2  .2  0 

A,  “  !  .2  .2  0 

!_  0  0  «3_ 


o : ,  b  -  b 
o  ; 


r° 

!  18  , 
L°  J 


b  -  b,  *  .8 

*  5  0 
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The  best  known  algorithm  for  generating  a  fixed  set  of  an  IFS  is  the  "Random 
Iteration  Algorithm"  or  "Chaos  Game".  It  is  an  extrapolation  of  the  scheme 
presented  in  example  1.  Instead  of  computing  the  complete  set  function  at  each 
iteration,  we  randomly  choose  a  single  contraction  map  from  the  IFS  to  iterate 
the  last  point  only. 

The  RIA  (Random  Iteration  Algorithm)  relies  on  fixed  probabilities 
associated  with  each  contraction  map  in  the  IFS.  The  probabilities  are  chosen  to 
describe  the  area-relationship  of  each  map  to  the  whole. 

Area-relationships  of  affine  maps  are  easily  calculated  by  determinants. 

For  example,  if  f(x)  -  Ax  +  b  then  f  will  map  the  unit  square  (in  R  )  with 
vertices:  (0,0),  (1,0),  (1,1),  and  (0,1)  to  a  parallelegram  with  area  equal  to 

the  determinant  of  A. 

Thus ,  if  an  IFS  is  given  by  {^ :  i  ■  1,  ...»  n}  and  each  f^x)  ■  A^x  +  b^, 

then  we  will  assign  a  probability,  p^ ,  to  each  f^  via  the  formula: 
det  At 

pi  - -  * 

J  det  A, 

1-1 

This  will  Insure  that  those  contraction  maps  dealing  with  "a  lot  of  area"  have 

a  higher  probability.  If  detAj  -  0,  then  assign  a  small  probability  like  0.01 
to  fr 

The  RIA  can  be  described  as  follows: 

1.  Given  an  "IFS  with  probabilities":  {f^,  p^;  f 2 » P2 *  ***’  ^n*  Pn^  80 

n 

that  l  p.  -  1. 

1-1  1 

2.  Pick  a  fixed  point,  xoj^,  of  one  of  the  f^'s. 

3.  Generate  a  uniform  random  number,  r,  between  rero  and  one. 
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.  Choose  k  so  that  £  p  <  r  <  )  p . . 

1-1  1  ~  i»l 

5.  Let  x  =  f.  (x  ,  ,  )  and  graph  x  ,  . 

new  k  old  r  old. 

6.  Let  x  ,  ,  be  replaced  by  x  and  repeat  steps  3  through  6. 

old  new 

The  RIA  is  very  efficient.  All  the  figures  in  this  section  were  created 
with  the  RIA. 

FACT :  Small  changes  in  the  parameters  (entries  of  the  matrices  and  vectors) 

of  an  IFS  will  cause  small  changes  in  the  fixed  set  (picture). 
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Figure  6 

"This  Sierpinski  Triangle  is  the  fixed  set  of  three  contraction 
maps:  f^ (x)  »  A^x  +  ,  i  -  1,  2,  3  where 


Figure  7 


"This  sjiral  wi:>  .’te-ifed  using  two  contraction  maps  with  matrices 


and  vectors  given  by 


bl 

Uj 


»nd 


i  e ; 

If  J 


where 


___a  _  _b _ _ d _ C _ f_ 

f,  .85  -.31  .3!  .85  1  -Id 

f  -.3  0  0  -.3  lO  -1 
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Figure  8 


'  "Continuing  the 

notation  from  Figure 

7,  this 

figure 

is  the  fixed 

set  of  the  IFS 

given 

by: 

1 

a 

b 

C 

d 

e 

f 

>  fl 

0 

0 

0 

.5 

0 

0 

i 

♦ 

f3 

.42 

-.42 

.42 

.42 

0 

.2 

.42 

.42 

-.42 

.42 

0 

.2 

.1 

0 

0 

.1 

0 

.2 
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Figure  10 


"The  IFS  for  this  figure  is: 


a 

b 

c 

d 

_ f _ 

.6 

0 

0 

.6 

.18 

.30 

f2 

.6 

0 

0 

.6 

.18 

.12 

f3 

.24 

.3 

-.3 

.4 

.n 

.36 

.4 

-.3 

.3 

.4 

.27 

.9 
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Figure  13 


"This  dragon's  tail  was  created  with 


a  b  c 


f  j  «2  “  •  3  .3 

f2  .9  -.1  .1 
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Figure  14 


star-burst  fractal  was  created  with  an  1FS  of: 


a _ Li _ c _ d _ e _ f 

fj  -.707  .707  .707  0  10  1 

f2  .5  0  0  -.8  10  1 

f  0  0  .5  -.5  10  0  . 
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Exercises 


1.  What  Is  the  dimension  of  the  Sierpinski  Triangle? 

2.  Recall  that  the  matrix  [c°8®  8ln®]will  rotate  points  in  R2,  0  radians. 

L  8 ino  cos  0  J  ’ 


counterclockwise  about  the  orgin.  Write  |  **  1  as  r [ cos® 

!.  -.1  . 85 i  L  sin0 

What  is  r  and  6.  Note  that  r  is  the  contraction  ratio. 


-sin0  1 
cos0  J 


3.  What  is  the  approximate  dimension  of  the  fern  in  RJ  described  in  the 


second  half  of  example  3?  (Hint:  When  dealing  with  a  function  which 
doesn't  have  an  easy  contraction  ratio,  bound  it  by  2  functions  which  do. 
This  will  give  bounds  on  the  dimension  when  using  the  fact  in  section  1.11.) 

4.  If  f(x)  -  Ax  +  b,  under  what  conditions  will  I-A  be  an  invertable  matrix,  so 
that  the  fixed  point  of  f  may  be  found?  (Hint:  Consider  the  eigenvalues 
of  A.) 


5.  It  can  be  shown  that  if  A  is  a  2  x  2  matrix  and  f(x)  ■»  Ax  +  b,  then  f  is  a 
contraction  map  if  and  only  f: 


In  fact,  the  ratio  of  f  is  the  quantity  on  the  left-hand-side  where: 

IAI2  **  a2  +  b2  +  c2  +  d2  and  |A|2  ■  (detA)2.  Find  the  dimension  of  the 


fractal  in  figure  14.  What  is  the  ratio  of  a  rotation  map? 
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II. 1  Introduction 


The  study  of  chaos  is  better  described  as  a  study  of  the  paths  to 
chaos.  Typically,  a  physical  system — like  a  driven  pendulum— will  undergo 
predictable  regular  behavior  through  a  continuous  change  of  a  parameter  (in 
the  motor),  until  all  at  once,  Irregularity  is  observed.  Or,  a  column  of 
smoke  from  a  cigarette  will  rise  in  easy  patterns,  until  at  some  height  it 
breaks  up  and  becomes  turbulent.  Or,  the  fluid  flow  in  a  blender  seems  to 
follow  regular  swirls,  until  at  some  speed,  it  looks  random. 

Obviously,  there  are  magnitudes  of  irregularity,  and  chaos  is  not  always 
an  apt  term  for  some  of  the  less  dramatic  behavior  of  these  systems.  But  the 
connotation  that  the  word  chaos  provides  is  appropriate:  there  is  an  order  of 
complexity  in  the  system  which  makes  it  unpredictable.  This  complexity  is 
usually  a  symptom  of  a  nonlinear  system.  Linear  systems  have  highly  regular 
behavior  through  all  changes  in  their  parameters.  But  a  nonlinear  system  has 
an  amazing  potential  for  strange  behavior. 

Some  thought  on  observations  of  physical  systems  leads  us  to  suspect 
noise,  and  at  very  small  scales,  quantum  effects  as  the  culprits  behind 
unpredictability.  Noise  and  Heisenberg's  uncertainty  principle  are  not 
explained  away  or  even  encompassed  by  chaos  theory.  They  are  additional  limits 
to  observations.  Chaos  provides  randomness  from  seemingly  exact  mathematical 
models.  Noise  and  quantum  effects  provide  additional  unpredictability  to  the 
exact  model.  This  report  will  no  address  the  effects  of  noise  and  quantum 
principles. 
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First,  we  will  discuss  what  a  nonlinear  function  can  do  when  applied 
repeatedly  to  a  point  (iterated).  This  is  the  study  of  orbits,  and  it  leads 
to  invariant  sets  and  attractors,  all  of  which  have  physical  significance. 

We  will  tie  this  to  fractals  by  noting  that  many  natural  invariant  sets  and 
attractors  are  also  fractals. 

Perhaps  the  most  astonishing  facts  in  chaos  theory  come  from  universality. 
Mitchell  Feigenbaum  has  shown  that  many  of  the  paths  to  chaos  are  essentially 
the  same.  When  viewed  from  the  parameter  space,  (the  parameter  whose  change 
will  bring  unpredictability),  the  progression  to  chaos  of  a  driven  pendulum 
will  be  "the  same"  as  that  of  a  small  cell  of  heated  fluid.  Two  univeral 
constants,  a  *  2. d0290787. . .  and  6  *  4.66920i6. . . ,  will  show  up  in  both  of 
these  systems.  These  discussions  will  focus  on  the  "bifurcation  diagram." 

After  universality,  we  will  also  present  some  basic  complex  number  dynamics, 
to  include  the  Mandelbrot  Set,  and  finish  with  a  discussion  of  randomness. 


69 


II. 2  The  Poincare  Map 

One  of  the  most  useful  spaces  in  which  to  describe  physical  phenomena  is 
called  phase  space.  It  frequently  involves  twice  the  number  of  dimensions 
needed  to  describe  the  system  itself  because  phase  space  usually  contains 
information  on  both  the  position  and  velocity  of  the  system.  We  are  plotting 
dependent  variables  against  each  other.  For  example,  x(t)  and  v(t).  Phase 
space  allows  us  to  tell  how  a  system  evolves  in  time.  The  path  (trajectory)  in 
phase  space  shows  how  the  system  behaves.  If  the  path  is  confined  to  a  region, 
that  says  something  about  the  system's  nature. 

If  a  pendulum  is  oscillating  in  a  plane,  then  only  the  angle,  0,  is 
necessary  to  describe  the  pendulum's  position.  So,  it  is  a  one-dimensional 
system.  Rather  than  graph  e  versus  time,  t,  phase  space  will  plot  0  versus  0 
(where  0  *  d0/dt). 

If  the  pendulum  Is  not  oscillating  in  a  plane,  (this  is  realistic  due  to 
the  Coriolis  effect),  then  two  angles  are  necessary  to  describe  its  position. 
Thus,  a  graph  of  position  versus  time  would  require  three  dimensions,  whereas 
the  phase  space  is  four  dimensional. 

Because  phase  space  is  usually  of  a  dimension  which  precludes  graphing, 
it  is  often  useful  to  use  a  Poincare  section  on  a  difficult  trajectory.  The 
trajectory  in  the  first  example  will  be  close  to  a  circle,  parametrized  by  time 
(and  thus,  with  direction).  But,  if  the  pendulum  is  driven,  the  trajectory 
need  not  close  back  on  Itself.  One  way  of  simplifying  this  is  to  intersect  the 
trajectory  with  a  curve  (or  line).  This  curve,  with  its  points  of  intersection, 

A 

(usually  labeled  with  the  time  of  intersection),  is  the  Poincare  section. 

The  Poincare  map  is  the  function  which  gives  a  point  of  intersection  from 
the  trajectory  and  the  Poincare  sec; ion.  In  the  case  of  the  driven  pendulum,  we 

A 

will  obtain  a  different  Poincare  map  (and  Poincare  section)  with  each  change  in 
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Pendulum 


Simple  Harmonic  Motion 
CPosi'-ion  vs  Time) 


Simple  Harmonic  Motion 
(  r>''ase  Sparc  ) 


Poincare  Section 

(Tne  curve  is  at  tine:  0,  {■/?. ,  and  P) 


k 


/ 


/ 

/ 


1-  cycle  with  period,  P 


Chaos 

(No  period) 


the  nonlinearity  constant:  that  number  which  describee  the  driver.  For  very 
small  values  of  this  number,  we  will  still  obtain  a  1-cycle  (closed  curve). 
Then  at  a  fixed  value,  a  2-cycle  will  appear.  For  smaller  and  smaller  changes 
in  the  nonlinearity  constant,  4-cycles,  8-cycles,  etc.  will  develop  until  at 
last,  chaos  will  prevail.  In  this  case,  chaos  simply  means  that  there  is 
no  cycle,  and  so  the  motion  is  irregular.  This  progression  to  chaos  is  best 
seen  through  a  bifurcation  diagram.  (See  II. 7). 


Nonlinearity  Parameter 


Another  version  of  the  Poincare  map  (also  <. .-tiled  the  return  map)  is 
obtained  by  fixing  a  value  for  the  nonlinearity  parameter  and  fixing  a  Polncaie 
section.  We  then  start  the  trajectory  at  an  arbitrary  point  in  phase  space 
and  number  the  consecutive  intersections  with  the  Poincare  section  (instead  of 
just  looking  at  the  limit  trajectory  and  labeling  the  time  of  intersection).  A 
function,  f,  is  defined  as  ffx^)  -  :i+[,  where  *n  and  Xn+1  are  consecutive 
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positions  on  the  Poincare  section.  By  starting  the  trajectory  at  all  points  in 
phase  space,  wt  obcain  a  continuous  function,  f.  It  turns  out  that  nearly 
all  such  Poincare  naps  have  the  same  generic  shape:  that  of  an  inverted 
parabola,  (although  it  usually  is  bounded  since  we  usually  limit  ourselves  to  a 
bounded  region  in  phase  space). 

Because  of  the  va;  this  Poincare  map  is  defin'd,  the  fundamental  technique 
in  studying  it  is  the  iteration  of  centirous  functions.  I  f  repeated 
applications  of  the  function,  f.  bring  us  closer  to  s  single  point,  then  we  are 
approaching  a  fixed  point  of  f,  and  it  corresponds  to  a  i-cvcle  in  phase  space. 

Exercises. 

1.  An  ideal  pendulum  (with  planar  motion)  with  no  friction  will  regularly 
repeat  any  state  it  is  started  i  it.  Thus,  the  limit  trajectory  is  always  a  1- 
cycle.  If  we  measure  theta  from  -it  to  it,  reason  that  the  Pofncare  map  (return 
map)  will  be:  f(x)  =  y,  for  -it  <  x  <  u.  (U so  the  9-axis  as  the  Poincare 
sect  ion.  ) 

•  + 

2.  Do  the  sane  as  in  problem  1  hut  use  the  9-axis  as  the  Poincare  section. 

(•■'hat  will  the  domain  of  the  return  map  be? 


II. 3  Iterations  of  Continuous  Functions:  Orbits 


Because  the  Poincare  map  can  reduce  the  dimension  and  complexity  of  a 
physical  system's  behavior,  it  is  very  useful  in  the  study  of  chaos.  The  return 
map  is  usually  a  continuous  function  defined  on  an  interval  which  is  strictly 
increasing  to  a  maximum  and  then  decreasing.  This  generic  characteristic  of 
most  Poincare  maps  led  mathematicians  to  study  their  behavior  without  reference 
to  any  physical  system. 

The  most  commonly  used  technique  to  analyze  behavior  of  return  maps 
involves  repeated  iterations  of  functional  values.  We  start  with  a  fixed 
value,  Xq,  and  compute  f(x^)  “  xjt  f(f(xQ>)  *  f(x^)  *  x2»  etc.,  to  obtain  the 
orbi t  of  Xp .  The  orbit  is  a  sequence  of  numbers,  { } n=o »  which  can  display 

many  types  of  behavior: 

1.  Each  x  is  either  the  same,  or  eventually  the  same.  That  Is,  fx  }  is  a 

n  ’  1  1  n1 

constant  sequence.  Recalling  that  the  Poincare  map  is  derived  from  a  fixed 
Poincare  section  and  nonlinearity  parameter,  the  significance  of  this  is  that 
the  physical  svstem  is  going  through  a  1-cycle. 

2.  Every  n  values  of  the  orbit,  {x^},  repeat.  This  implies  that  the 
system  is  going  through  an  m-cycle. 

3.  The  orbit  gets  closer  and  closer  to  m  repeating  values.  This  system 
has  an  m-cycle  as  irs  limit  trajectory,  but  the  particular  orbit  chosen  is  not 
on  that  trajectory.  It  merely  approaches  it. 

4.  The  orbit,  { xn ) »  ls  dense  in  the  domain  of  the  return  map.  Most 
definitions  will  include  this  as  a  criterion  for  chaos.  We  can  imagine  the 
trajectory  of  the  physical  system  as  rendomly  filling  up  its  phase  space:  like 
a  notorized  spinning  cue  ball  rebouncing  on  a  billiard  table  (without  pockets). 


5.  The  orbit  seems  to  be  random,  as  in  4,  but  is  localized:  that  is,  it 
never  goes  in  some  regions  of  the  domain.  The  trajectory  of  this  system  is 
influenced  by  some  attractor,  quite  possibly  a  fractal.  (These  are  often  called 
strange  attractors,  and  will  be  discussed  more  in  section  11.5.) 

All  of  the  behaviors  listed  above,  while  significant  to  the  physical 
system,  can  be  studied  using  simple  mathematical  tools. 

A  useful  geometric  trick  is  described  in  the  following  example: 


Example  1. 


let  f(x)  **  x(l  -  x) ,  for  x  e  [0,1].  Find  the  orbit  of  x^  =  y  . 

12  1  1 

The  straightforward  approach  involves  finding  f(|-),  f  (y)  *  f(f(-~)),  etc.: 

1  13  13 

we  would  get  y,  •£,  -j^-,  •••  The  arithmetic  gets  tedious,  and  a  calculator  or 

computer  is  useful.  But  the  qualitative  behavior  of  the  orbit  of  y  can  be 
gleaned  from  the  following  geometric  technique: 
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If  we  belipve  the  diagram,  it  is  obvious  that  the  orbit  is  converging  to 
zero.  This  technique  works  as  follows:  Vie  start  at  x^  and  go  up  to  the 
graph  of  f  to  find  f(x^).  This  value  is  x^  but  is  represented  as  a  height  on  the 
y-axis.  To  represent  x^  on  the  x-axis,  we  go  horizontally  to  the  line,  y  «  x, 
and  then  vertically  (down)  to  the  x-axis.  The  distance  from  zero  to  x^  is 
exactly  the  height  of  Xj  »  f(x^).  We  then  repeat  this  process  ad  infinitum 
to  observe  the  orbit,  {x^}.  In  this  case,  the  x^'s  obviously  decrease  to  zero,  a 
limit  point.  (This  corresponds  to  a  physical  system  approaching  a  1-cycle,  or 
losing  energy  to  a  state  of  no  motion.) 

Example  2. 

Define  f^(x)  ~  *xO  ~  x),  for  x  e  {0,  1).  When  X  »  1,  the  function  of 
example  1  is  obtained.  X  is  a  nonlinearity  parameter,  and  changes  in  X  can  put 
us  on  the  path  to  chaos.  (See  the  exercises.) 


Example  3. 


Define  g^(x) 


Xx.  if  0  <  x  _<  j 


j_  X(1  -  x),  if  j  <  x  <  1. 

Again,  X  is  a  nonlinearity  parameter.  The  functions  defined  by  g  are  called 
tent  maps  because  of  their  shape.  The  functions  defined  by  f  are  called 
logistic  maps . 

When  X  *  2,  ^  can  be  analyzed  with  a  numerical  trick: 

Write  the  numbers  in  [0,  1 |  in  their  binary  expansion.  Then  note 
that  since  g2(x)  3  2x  or  g2(x)  3  2(1  -  x),  (and  2  =  10  base  2),  calculations  of 
gj  are  very  easy.  In  the  following  explanation,  all  numbers  with  a  point, 
are  base  2. 
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For  example,  If  “  .01011,  then  since  the  first  digit  is  a  zero,  xQ  <  y,  so 
g2(xQ)  *  2xq  =  .1011  -  Xj.  Now,  x^  23*  80  g2(Xj)  ”  2(1-Xj)  =  2C.0101)  =  .101  »  x2> 
Then,  g2(x0)  »  2(l-x2>  «  .11  -  Xy  g^Xj)  =  2^1-x3)  =  =  x^,  g2(x^)  ■  1  ■  x^,  and 

g2(x^)  “  0.  So,  “  x^  =»  •••  =  0.  Thus,  the  orbit  is:  {.01011,  .1011,  .101, 

.11,  .1,  1,  0,  0,  ...1. 

2 

Note  that  the  line  y  =  x  will  intersect  g2  at  x  =  2(l-x);  or  x  =  y. 

2 

y  “  .10  base  2,  so  we  can  check  that  .101010  ...  is  really  a  fixed  point  of  g2: 

2  2  2 

g2(y)  “  2(1  -  y)  -  y.  We  can  note  a  few  things  about  the  return  map  given 
by  g2 .  First,  any  x^  which  can  be  expressed  as  a  finite  decimal  in  base  2, 
will  have  an  orbit  which  is  eventually  always  zero.  Zero  and  two-thirds  are 

the  only  fixed  points  and  the  only  points  of  g2  which  will  have  orbits  that  fix 

?  _ 

onto  y  must  end  in  10  (base  2). 

In  fact,  every  rational  number  in  [0,1J  will  have  an  orbit  which  eventually 
corresponds  to  an  m-cycle,  for  some  m.  (The  above  remarks  are  detailed  in  the 
exercises . ) 

This  has  an  interesting  application  to  computer  calculations  with  g2« 

We  might  expect  irrational  orbits  to  behave  chaotically;  but,  this  cannot 
be  simulated  on  a  computer  since  any  computer  representation  of  an 
irrational  number  is,  in  fact,  rational.  If  done  correctly  in  base  2,  then  the 
computer  will  always  end  up  at  zero. 

There  Is  a  technique  which  can  glean  more  information  from  chaotic  maps. 

It  is  called  symbolic  dynamics,  and  we  recommend  An  Introduction  to  Chaotic 
Dynamical  Systems  by  Robert  Devaney. 
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Exercises 


1.  In  example  1,  find  the  orbit  of  0.  What  is  the  orbit  of  1?  And  y  ? 

2.  In  example  2,  find  all  the  fixed  points  of  f^  when  0  <  X  _<  4. 

3.  For  A  »  2,  find  the  orbits  of  0,  1,  and  y  under  f^(x)  “  Ax(l  -  x). 

4.  For  f^  as  above,  what  value  of  X  will  force  f^  to  intersect  the  line, 

,  1  ,  2 
y  ■  1,  at  x  “  y  and  x  ■*  y  . 

5.  Same  as  problem  4  with  f^  replaced  by  (the  tent  map)  of  example  3. 

1  2 

6.  In  problems  4  and  5,  for  the  given  value  of  X,  if  y  <  x  <  y  then  f^(x) 
and  g^(x)  are  not  in  the  interval  [0,1].  Find  the  values  of  x  such  that 
f"(x)  is  still  in  [0,1]  for  every  value  of  n.  Will  these  values  of  x 
change  when  we  examine  g^? 

7.  In  example  3,  find  the  orbit  of  .010111  base  2  under  • 

8.  Find  the  orbit  of  yy  under 

9.  Prove  that  if  x^  has  a  finite  representation,  base  2,  then  g”(x0)  is 
eventually  zero. 

10.  Prove  that  if  x^  is  rational  with  an  infinite  base  2  representation  that  ends 
in  repeating  "10",  then  g£(xg)  is  eventually  y  . 

11.  Prove  that  if  is  rational,  then  there  exists  a  positive  integer,  m,  so 
that  the  orbit  of  x^  under  g£  will  eventually  repeat  exactly  m  values. 

12.  Show  that  there  is  an  Xq  (irrational)  such  that  the  orbit  of  x^  Is  dense 
in  [0,1]  under  ^ • 
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II. A  Periodic  Points 


Periodic  points  are  points  whose  orbits  (under  the  return  map)  repeat  a 
l i nite  sequence. 

Definition  1.  The  point,  x^ ,  is  periodic  under  f  if  and  only  if  there  is  a 
positive  integer,  n,  so  that  fn(Xg)  =  x^.  If  n  is  the  least  such  integer, 
then  n  is  called  the  prime  period  of  x^. 

Thus,  a  fixed  point  has  prime  period  one  and  corresponds  to  a  i-cycle  in 
phase  space.  Similarly,  if  x^  has  prime  period  m,  then  there  is  an  m-cycle  in 
phase  space  which  will  intersect  the  Poincare  Section  at  and  then  at  n  -  I 
other  values  before  returning  again  to  Xq. 

There  are  two  fundamental  questions  pertaining  to  periodic  points: 

1.  Is  a  given  periodic  point  an  attractor? 

2.  How  many  periodic  points  are  there?  (And  where?) 

Definition  2.  A  periodic  point,  x^  ,  of  period  m  of  f  is  an  at  t  ractor  if  and 
only  if  there  is  an  an  e  >  0  so  that  if  j x  -  xn j  <  e  then  lim  fmn(x)  e  xn. 

The  periodic  point,  x() ,  is  a  repel  lor  if  and  only  if  there  is  an  f  >  0 
so  that  if  0  <  jx  -  x^j  <  e  then  there  is  a  k  such  that  j  f  *cm( )  -  x^|  e. 

Attractors  are  also  called  sinks  if  they  are  fixed  points,  just  as 
repel lors  are  called  sources. 

fortunately,  it  is  usually  easy  to  determine  whether  a  given  periodic 
point  is  an  attractor  or  repcllor: 

Theorem  1 .  If  x^  is  a  fixed  point  of  f  and  J f * ( Xq ) j  <  1,  then  x^  is  an 
attractor.  If  jf'(xg)|  >  l,  then  Xq  is  a  repellor. 
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Proof:  Assume  j  f ’ <  xQ ) 1  <  1.  Then  there  is  an  e  >  0  so  that  if  |x  -  Xg|  <  e, 
j  f (x)  -  f(xQ) 1 

- ,<  r  where  r  <  1. 

x  ■  xo  r 

Thus,  for  all  x  In  the  interval  (Xg  -  e,  xQ  +  e)  ,  |f(x)  -  f(xQ)|  <  r  |x  -  Xg| , 

which  shows  that  f  is  a  contraction  mapping  on  (xQ  -  e,  xQ  +  e)  with  fixed 

point,  xf).  So,  if  |x  -  xQ|  <  e,  then  lim  f(x)  -  xQ. 

Assume  |  f ’ ( x0 ) )  >  1.  Then  there  is  a  6  >  0  so  that  if  |x  -  xfl|  <  ft, 
i  f(x)  -  f(xQ)  j 

-  >  q  where  q  >  1. 

x  "  x0 

Hence,  on  (xfl  -  6,  xQ  +  6),  |f(x)  -  f(Xg)|  >  q  |x  -  xQ|.  So,  given  x  such  that 

[ x  -  xQ|  <  6,  f(x)  is  farther  from  xQ  than  x  is;  (q  >  1).  Thus,  there  is  k  and  5 

so  that  |fk(x)  -  xQ |  >  J,  completing  the  proof. 

It  is  easy  to  extend  theorem  1  to  general  periodic  points: 


Theorem  2.  If  xfl  has  prime  period  m  under  f,  then  Xq  is  attracting  if 

I  I 

j  ~  fn(x0)  <  1  and  repelling  if  I fm(xg)  !  >  1*  Moreover,  if  x'0  is  any 
point  in  the  orbit  of  xQ ,  then  fm(x’ Q)  -  ^  fm(x0),  implying  that  the  orbit  of 
x^  shares  the  properties  of  x^  Itself  when 

I  j  m  1  n 

Proof:  First  assume  f  (xn)  |<  1.  Then  x„  is  an  attracting  fixed  point  of  f  . 

!  dx  0  i 

So,  we  need  only  show  that  if  x^  is  in  the  orbit  of  Xg,  then  ^  f  (Xg)  ” 


i  f"(V 


*  1. 


A 

But,  —  fffl(xn)  •  II  f(x.)  by  the  chain  rule,  where  x  *  f(x  .)  for 
dx  0  i  i  i  i 

i  *  1,  ...,  m-  1.  Thus,  the  derivative  of  fR  at  Xg  is  the  sane  as  that  at  any 
other  point  in  the  orbit  of  Xg ,  completing  the  proof. 
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Theorem  2  can  be  used  with  the  definition  of  an  attract ing  periodic  point  to 
show  that  if  —^■fm(Xp)  <  1,  (where  x^  has  prime  period  n  under  f),  then  there 

is  an  e  >  0  such  that  when  (x  -  x J  <  e,  lin  jfn(x)  -  fn(xn)’  =  0.  Essential! v , 
the  entire  orbit  attracts  x.  This  will  be  discussed  more  in  the  next  section. 

Definition  3.  A  periodic  point,  ,  of  prime  period  n  under  f  is  called 

hyperbolic  if  and  only  if  #1.  Otherwise  it  is  nonhyperboli c . 

(Branch  points  in  a  bifurcation  diagram  are  always  nonhvperbol i c .  See  section 

II. 7.  ) 

Example  1.  Let  f^(x)  ®  Ax(l  -  x)  be  the  logistic  map  introduced  in  the  last 
suction,  for  X  >  0,  and  0  (  x  <  1. 

First,  find  all  periodic  points  and  classify  them  when  0  <  X  <  1. 

It  is  easy  to  see  that  zero  is  the  only  periodic  point  of  when  0  <  X  <  1. 
fj(0)  =  X,  so  zero  is  attracting  when  X  <  1. 

When  X  =  1,  zero  is  nonhvperbolic,  but  still  attracting  (wnaklv  attracting). 
Next,  wo'.)J  consider  X  >  1. 

Here,  f  ^  has  another  fixed  point  at  (X  -  1 ) / X .  So  f^  has  2  fixed  points, 
f' *  2  -  X,  showing  that  (X  -  1 ) / A  is  attracting  and  hyperbolic  when 

A 

1  <  X  <  3  and  repelling  and  hyperbolic  for  X  >  3.  Geometric  considerations 
show  that  (X  -  1 ) / X  Is  weaklv  repelling  (nonhyperbolic )  for  A  =  3. 

The  above  completely  describes  the  fixed  point  behavior  of  f^. 

Next,  wc ' 1 1  try  to  find  points  of  prime  period  2... 

To  do  this,  we'll  look  for  fixed  points  of:  f^(x)  =  +  ^X^x^  - 

(  X^  +  X^)  x^  +  X^x.  Thus,  we'll  solve  f^(x)  ~  *  “  0,  which  must  have  0  and 

2 

(X  -  1)/A  as  solutions  (X  >  1)  since  they  are  fixed  points  of  f^.  Thus,  we  can 
2 

reduce  f^(x)  “  x  “  0  to  a  quadratic  equation: 
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-X3x2  +  (X3  +  X2)x  -  (X2  +  X)  *  0,  or  X2x2  -  (X2  +  X)x  +  (X  +  1)  **  0.  The  discrim¬ 
inant  of  the  latter  quadratic  is: 

D  -  X2(X  +  1)(X  -  3). 

Since  we  are  assuming  X  >  1,  (in  order  to  have  (X  -  1 ) / X  be  a  fixed  point),  we  can 

see  that  D  is  negative  until  X  ^  3.  Thus,  there  are  no  periodic  points  of  prime 

period  2  until  X  >  3.  (When  X  =  3,  the  discriminant  is  zero  and  the  old  fixed 

point:  (X  -  1)/X,  has  multiplicity  3). 

2 

Note  that  the  roots  of  f^(x)  ~  x  are  a  continuous  function  of  X.  So,  at  X  ■  3 
we  have  one  repelling  fixed  point  at  zero  (a  root  of  multiplicity  one),  and  a 
weakly  repelling  fixed  point  at  2/3,  (X  — 1 ) / X ,  which  is  a  root  of  multiplicity  3. 
This  root  at  2/3,  will  split  into  3  distinct  roots  for  x  >  3.  One  of  them  is 
( X— 1 )/ X  which  is  still  a  (repelling)  fixed  point,  but  the  other  two  are  new  points 
of  prime  period  2. 

Are  these  new  periodic  points  attracting  or  repelling  or  nonhyperbolic? 

By  evaluating  the  quadratic  formula,  we  obtain  the  2  new  points  of  prime 
period  2: 

X+l  +  ✓(X+l )(X-3)  .  X+l-/( X+l ) ( X-3 ) 

po  = - -2T -  and  Pl»  - 2^ - 

when  X  >  3.  Also,  ^f^CPg)  “  f^(pQ)f^(pj) 

*  X ( 1  -  2pQ)  •  X( 1  -  2pj ) 

»  -X2  +  2X  +  4. 

Thus,  Pq  and  p^  are  attracting  when  3  <  X  <  1  +  /6,  nonhyperbolic  for  X  »  1  +  /6, 
and  repelling  when  X  >  1  +  /6. 

If  the  previous  pattern  from  fixed  point  to  2  points  of  prime  period  two 
repeats,  then  we  would  expect  each  point  of  prime  period  2  to  "give  birth"  to  two 
points  of  prime  period  4  (for  a  total  of  4  points  of  prime  period  four)  when  the 
period  2  points  are  nonhyperbolic  at  X  ■  1  +  fb. 
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We  will  now  turn  to  the  question:  how  many  periodic  points  are  there? 


2x  ,  if  0  _<  x  <  1/2 

Example  2.  Let  gj(X)  =  < 

"  2 ( 1 -x )  ,  [if  1/2  <x  <  1. 

So  gj  is  the  tent  map  from  the  previous  section.  It  is  easier  to  find  the  periodic 
points  of  this  map  tnan  the  logistic  map  of  example  1. 

We  will  develop  a  geometric  technique  to  find  periodic  points  of  different 
order. 

First,  periodic  points  of  order  1  are  fixed  points  and  are  obtained  from  the 
intersection  of  g2  with  the  identity  map: 


So,  g2  has  fixed  points  at  0  and  2/3. 

To  find  points  of  prime  period  2,  we  graph  g2<  This  can  be  done  without  an 

2  2 

explicit  representation  of  g^  !  Note  that  g,,(x)  "  80  t'lat  the  ranEe 

values  of  g9  then  become  the  domain  values  for  the  next  gj.  Thus,  since  g2  maps 
[0,  1/2]  onto  [0,1],  (g2 (x ) )  will  go  through  a  complete  up  and  down  graph  for 

x  e  (o,  1/2]  and  for  x  e  [  1 /2 ,  l]... 


33 


Hence,  will  intersect  y  -  x  at  4  points,  two  of  which  must  be  0  and  2/3.  The  2 
new  points  are  points  of  prime  period  2. 

We  can  repeat  this  graphical  technique  to  find  periodic  points  of  order  n. 

It  is  clear  tnat  in  this  case,  as  n  +  we  will  obtain  an  infinite  number  of 
periodic  points.  And,  the  collection  of  all  periodic  points  will  be  dense  in  the 
interval,  (0,1]. 

One  of  the  properties  of  which  lends  itself  to  this  technique  Is  that  the 

maximum  value  of  is  the  same  as  the  maximum  value  of  the  domain:  one.  In 

example  1  the  logistic  map,  f^,  will  not  achieve  a  maximum  value  of  one  until 
X  «  4.  For  this  value,  f^  and  g.,  have  essentially  the  same  behavior.  The  hard 

part  is  tracking  their  behavior  when  X  <  A  (for  f ^ )  and  X  <  2  for  (See  the 

exercises . ) 

We  will  now  look  at  the  case  when  X  >  2  for  g^,  (which  is  the  same  as  that 
for  f ^  when  X  >  A).  In  particular,  we'll  examine  g.^(x). 

f  3x  ,  if  0  <  x  <  1/2 

Example  3.  Let  g-,(x)  *  { 

[  3( i-x)  ,  if  1/2  <  x  <  1. 

The  most  Important  dlfforence  here,  from  earlier  cases,  is  that  when 
1/3  <  x  <  2/3,  g^fx)  >  1,  and  so  points  between  1/3  and  2/3  get  mapped  out  of  the 
domain  interval,  [0,1].  Repeated  applications  of  g^  will  take  these  points  to 

-•».  We  could  interpret  this  as  a  t/pe  of  resonance.  Initial  conditions  in  the 

flA 


physic.il  system  which  correspond  to  these  values  in  the  domain  of  the  return  nap 
are  carried  out-of-bounds . 

Put  the  values  between  1/3  and  2/3  are  not  the  only  ones  which  are 
attracted  to  For  example,  x  =  1/6  is  mapped  by  to  1/2.  And  now  1/2 

will  be  attracted  to  -«.  By  using  the  graphical  technique  in  the  previous 
example,  we  can  determine  that  every  point  in  [0,1]  except  those  in  the  Cantor 
Set  will  eventually  be  attracted  to  -«*: 


3  3 


I  2 
3  I  *3 


'  \  ./ 

■  »  i  \  /  :  ■  \ 

j  2^~t  7  2  1  i 

9  9  3  3  9  9  x 

That  is,  Pt(x)  will  take  2n  *  intervals  of  length  —  from  its  domain,  and  mno 
1  3n 

them  out  of  [0,1],  thus  sending  them  on  their  way  to  So,  the  points  in  the 

Cantor  Set  are  the  only  points  which  stay  in  [0,1]  after  arbitrary  iterations 


by  g 


3’ 

k 

Note  that  all  numbers  of  the  form  —  are  eventually  napped  to  zero,  and 


periodic  points  will  be  dense  In  the  Cantor  Set.  (See  the  exercises.) 
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Although  the  number  and  type  of  periodic  points  for  g^  is  closely  related 
to  the  number  and  type  of  periodic  points  for  f^,  (for  a  suitable  choice  of  6), 
there  is  a  fundamental  difference.  For  X  >  1,  g^  has  no  attracting  periodic 
points  since  the  slope  of  is  always  ±  X.  Thus,  is  useful  since  it's  easy 
to  work,  with,  but  not  very  realistic,  since  we  expect  physical  systems  to  have 
some  steady  state  solutions. 

He'll  conclude  this  section  with  a  remarkable  result  due  to  Sarkovskii. 

Theorem  3.  If  f  is  a  continuous  function  mapping  R  to  R  and  f  has  a  point  of 
prime  period  3,  then  for  every  natural  number,  n,  there  is  a  point  of  prime 
period  n. 

This  is  actually  a  corollary  to  Sarkovskii 's  theorem  which  gives  a  precise 
listing  of  what  periods  imply  what  other  periods. 

Thus,  and  g0  have  points  of  prime  period  n  for  all  n.  In  fact,  f^  has 
points  of  prime  period  3  for  X  *>  3.839. 


Exercises 

1 .  Uhat  is  the  degree  of 
known  roots  are  there 

2.  Uhat  is  the  degree  of 
to  f^(x)  -  x  -  0? 

3.  Use  numerical  methods 
X  -  1.01  +  /6. 


the  polynomial,  f^(x)?  If  3  <  X  <  1  +  /6,  how  many 
to  f^(x)  -  x  »  0? 

3 

the  polynomial,  f^(x)?  How  many  known  roots  are  thei 
to  find  four  points  of  prime  period  4  of  f^(x)  when 


4. 


Use  numerical  methods  to  find  three  points  of  prime  period  3  of  f^(x)  when 
X  =  3.839. 
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4  j- 

5.  Draw  a  graph  of  f^(x)  when  X  *>  1  +  /6.  (Hint:  Use  the  answer  to  prob  3  to 
make  the  graph  more  accurate. 

6.  Prove  that  g.(x)  maps  points  of  the  form  —  eventually  to  zero. 

J  3n 

7.  Find  the  two  points  of  prime  period  2  of  g^(x).  Are  these  points  in  the 
Cantor  sec?  If  so,  write  them  in  base  3  form  using  only  0's  and  2's. 

8.  Find  the  4  points  of  prime  period  four  of  g^(x).  Are  these  points  in  the 
Cantor  set?  If  so,  write  them  in  base  3  using  only  0's  and  2's. 
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II. 5  Invariant  Sets  and  Attractors 


We'll  start  with  a  couple  of  definitions. 

Definition  1.  A  set,  F,  is  an  invariant  set  of  the  (return1)  map  f  if  and  only 
if  for  each  x  c  F,  f(x)  e  F. 

Definition  2.  A  set,  P,  is  an  attractor  of  f  if  and  only  if  there  is  an  e  >  0  so 
that  if  p  is  any  point  in  P  and  x  is  any  point  such  that  d(x,p)  <  e  then  all 
limit  nolnts  of  the  orbit  of  x  are  contained  in  P. 

The  definition  of  invariant  set  is  straightforward.  For  example,  a  fixed 
point  is  an  invariant  set,  as  is  any  periodic  orbit:  that  is,  the  collection  of 
m  points  is  invariant.  A  more  Interesting  example  is  the  Cantor  set.  In  the 
last  section,  we  saw  that  the  Cantor  set  is  an  invariant  set  of  g^  and  fg/2- 
Attractors  are  fairly  easy  to  understand,  but  their  definition  is  tedious. 
Intuitively,  a  set,  P,  is  an  attractor  if  nearby  points  are  drawn  closer  and 
closer  by  the  return  map.  In  the  definition,  we  used  "d"  to  emphasize  that 
distance  can  be  measured  in  any  metric  space  and  we  are  not  limited  to  return 
maps  whose  domain  is  the  real  line  (or  subset  thereof).  Also,  if  the  orbit  of  a 
point  approaches  ®,  then  «  is  considered  to  be  a  limit  point  of  the  orbit,  and 
can  also  be  considered  an  attractor. 

Recall  from  part  I  that  the  fixed  point  of  every  contraction  map  is 
actually  an  attractor  of  that  map.  In  fact,  an  IFS  has  an  attractor  which  is  a 
fractal,  even  though  we  would  not  usually  consider  an  IFS  to  be  a  return  map  of 
some  physical  system. 
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In  a  physical  system,  an  invariant  set  corresponds  to  trajectories  which 
keep  intersecting  the  Poincare  section  in  the  same  set  of  points.  It  should  be 
noted  that  every  attractor  is  also  an  invariant  set,  but  has  the  additional 
physical  property  of  attracting  nearby  trajectories. 

Example  1.  Explain  the  physical  significance  of  the  logistic  map,  f^,  as  X 
increases  (X  >  1). 

We  will  give  a  physical  interpretation  of  the  information  presented  In 
example  1  of  II. A: 

For  1  <  X  <  3,  there  is  one  attracting  fixed  point  at  (X  -  1)/X.  All 
trajectories  (except  one)  are  drawn  to  this  fixed  point,  so  the  physical  system 
has  a  stable,  attracting  1-cycle  as  its  steady  state  solution.  Note  that  zero 
is  a  repelling  fixed  point,  so  it  can  be  considered  as  an  unstable  invariant 
sec.  The  one  trajectory  which  intersects  the  Poincare  section  at  zero  is  the 
only  one  which  isn't  attracted  to  (A  -  1 ) / X .  For  this  reason,  zero  is  ignored. 

For  3  _<  X  <  1  +  /6,  there  Is  one  attracting  set  which  is  an  orbit  of 
period  two.  The  fixed  point  at  ( X  -  1 ) / X  is  now  a  repellor,  and  hence  can  be 
Ignored.  For  all  practical  purposes,  the  physical  system  will  draw  all  tra¬ 
jectories  into  a  stable  steady  state  solution  of  a  2-cycle.  This  2-cycle  was 
generated  through  a  bifurcation  of  the  fixed  point  (X  -  1 ) / X . 

As  X  increases  through  l  +  /6,  the  stable  2-cycle  above  will  bifurcate  into 
a  stable  4-cycle  which  becomes  the  steady  state  solution  of  the  physical  system. 
Now  we  are  Ignoring  two  repelling  fixed  points — at  0  and  (X  -  1 ) / X  — and  two 
repelling  points  of  prime  period  2.  For  fairly  obvious  reasons,  including 
noise,  it  is  Impossible  for  an  actual  trajectory  in  the  system  to  repeat  an 
unstable  or  repelling  cycle  (or  orbit). 
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This  bifurcation  behavior  will  continue  for  smaller  and  smaller  increases 


in  the  parameter,  X.  The  accumulation  point  will  correspond  to  a  type  of  chaos. 
At  this  chaotic  value  of  X  there  will  be  no  attracting  cycle,  so  the  motion  in 
the  system  will  be  irregular  and  aperiodic.  There  can  still  be  a  steady  state 
solution  (attractor),  but  it  will  not  be  periodic. 

Further  increases  in  X  will  show  periods  of  chaos  interspersed  with 
regular,  attracting  cycles.  When  the  cycles  exist,  they  will  bifurcate  as 
before  and  lead  to  another  period  of  chaos.  When  X  ■  4,  X  will  be  so  large  that 
no  attracting  solution  will  exist,  even  an  aperiodic  one.  At  this  value,  there 
is  no  attractor  and  the  system  is  completely  turbulent. 

Exercises . 

1.  For  X  >  2,  find  the  measure  of  the  invariant  6et  of  g^.  [Hint:  Add  up  the 
length  of  the  intervals  in  the  complement  of  the  invariant  set,  then  take  one 
minus  this.] 

2.  Can  g^  (X  >  1)  be  used  to  model  a  physical  system?  Explain. 


II. 6  Scrambled  Sets — Definitions  of  Chaos 

We  will  give  two  definitions  of  chaos  in  this  section.  To  do  so,  the 
concepts  of  "sensitive  dependence  on  initial  conditions"  and  "scrambled  sets" 
need  to  be  clarified. 

Definition  1.  A  function  (return  map)  has  sensitive  dependence  on  Initial 
c ond i t ions  if  and  only  if  there  is  an  c  >  0  so  that  for  every  x  and  every  i  ^  0 

there  is  a  y  and  n  such  that  d(x,y)  <  6  and  d(fn(x),  fn<y)  )  >  e. 

The  definition  states  that  arbitrary  accuracy  of  orbits  cannot  be  main¬ 
tained.  That  is,  there  is  an  t  )  0  so  that  no  matter  how  close  you  start  to  x, 

there  is  a  y  which  will  end  up  e  units  away  from  x  after  some  number  of 

iterations. 

This  behavior  is  strengthened  (worsened?)  by  scrambled  sets: 

Definition  2.  Suppose  f:  1  ♦  J  is  a  continuous  function  mapping  I  onto  J,  where 
J  it  a  subset  of  I.  Let  X  be  the  length  of  J.  S  is  a  scrambled  set  of  f  if  and 
only  if  for  every  x  and  y  in  S,  (x  *  y), 

(i)  lim  sup  jfn(x)  -  fn(y)j  *  X,  and 

n+« 

(11)  lim  inf  jfn(x)  -  f n(y )  j  ■*  0. 
n 

We'll  explain  "lim  sup"  and  "lim  inf":  the  lim  sup  as  n  ♦  °>  is  the 
supremum  of  values  achieved  by  |fn(x)  -  fn(y)j  as  n  ♦  Thus,  condition  (i) 
implies  that  any  two  points  In  S  will  be  iterated  as  far  apart  as  possible  (J  is 
the  limiting  factor).  At  the  same  time,  condition  (ii)  implies  that  these  two 
points  will  be  iterated  close  together  again  as  well.  The  terminology, 
"scrambled",  seems  understated. 
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First,  note  that  sensitive  dependence  on  initial  conditions  happens  for 
every  value  in  the  domain,  I.  (We  used  arbitrary  metric  space  notation  in 
definition  1  so  that  it  can  be  applied  to  higher  dimensional  situations.)  But 
the  behavior  in  a  scrambled  set  is  localized  to  that  set,  and  it  will  never  be 
the  entire  domain.  (A  metric,  d,  could  also  be  used  in  definition  2.) 

Second,  note  that  if  a  return  map  has  an  attracting  set,  it  cannot  have 
sensitive  dependence  on  initial  conditions  since  points  drawn  to  the  attractor 
will  stay  close  together. 

We  need  one  more  definition. 

Definition  3.  A  (return)  map,  f,  is  transitive  (or  nomadic)  if  and  only  if 
there  is  an  x  so  that  the  orbit  of  x  is  dense  in  the  domain  of  f. 

We  have  seen  this  behavior  for  back  in  section  II. 3. 

Now  we'll  present  two  definitions  of  chaos: 

Definition  A.  A  function,  f,  is  chaotlc-3  if  and  only  if  the  following  3 
conditions  are  satisfied: 

(i)  f  has  sensitive  dependence  on  intial  conditions, 

(ii)  f  is  transitive,  and 

(iii)  the  periodic  points  of  f  are  dense  in  the  domain. 

Definition  5.  A  function,  f,  is  chaotlc-s  if  and  only  if  there  is  a  scrambled 
set  of  uncountable  cardinality. 

In  the  article  "On  Scrambled  Sets  for  Chaotic  Functions",  Andrew  Bruckner 
and  Thakyin  Hu  showed  that  if  we  assume  the  continuum  hypothesis  (see  Funda¬ 
mentals  of  Contemporary  Set  Theory,  by  Devlin)  then  a  function,  f,  is  chaotic-s 

2 

if  and  only  if  the  second  iterate,  f  ,  is  transitive.  They  also  showed  that  ^ 
(the  tent  map)  is  chaotlc-s. 
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Example  1.  The  tent  map,  g 2,  is  also  chaotic-3. 

We  only  need  to  show  that  g^  has  sensitive  dependence  on  initial  condi¬ 
tions.  For  this  function,  we  can  choose  e  >  0  to  be  any  number  less  than  1. 

Fix  such  an  e.  Now  let  6  >  0  and  choose  m  so  that  —  <  6.  Fix  a  number,  x,  in 

2m 

[0,1]  and  write  x  in  base  2  as  x  *■  .d^dj  ***  w^ere  eflch  d^  e  (0,1).  Now,  we 
need  jo  find  a  y  within  S  of  x  so  that  after  some  number  of  iterations  fn(x)  and 
fn(y)  will  be  at  least  e  apart: 

Define  y  e  [0,1]  as  y  ■  ,eie2  ***  where  “  <i^  for  1  i  l  1  ®  and  e^  *  d^ 

for  all  i  >  m.  Thus,  y  -  x  has  zeros  in  the  first  m  positions;  and  hence, 

i y  ~  xl  <  ~  <5. 

f' z2 * 3  *  *  *  ^  ® 

.q2q3  ...  if  Zj  -  1 

where  *  z^  for  each  i. 

Thus,  after  iterating  x  and  y  m  times,  g^(x)  ■  *xm+jxm+2  •••  where  either 

each  xm+j  -  d^  or  each  x^  *  d^ ,  and  similarly  for  y:  g"(y)  »  .y^  ym+2... 

where  each  y  . .  *  x  . ,  .  This  last  fact  implies  that  |g1?(y)  -  g~(y)|  “  .F  base  2 
m+l  ro+1  4  4 

«  1.  So,  since  c  <  1 ,  we  have  shown  that  g2  has  sensitive  dependence  on 
initial  conditions. 

In  section  II. 3,  it  was  shown  that  g2  is  transitive  and  that  the  periodic 
points  of  gj  are  dense  in  [0,1].  Thus,  g2  is  chaotic-3. 

Example  2.  The  logistic  map,  f^,  is  chaotic-3  on  its  invariant  set  when 

1.  >  2  +  ✓?. 

First,  note  that  we  are  restricting  the  domain  of  f^  to  its  invariant  set 
since  if  X  >  U  (as  is  2  +  /5)  then  f^  will  take  the  majority  of  the  interval 
[0,1]  off  to  — .  Recall  that  the  invariant  set  will  be  a  Cantor-type  set  (the 
actual  Cantor  set  at  X  ■  9/2)  when  X  >  4. 
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Using  symbolic  dynamics,  it  is  possible  to  show  that  has  a  dense  orbit 
(in  its  invariant  set)  and  that  periodic  points  are  dense  (in  its  invariant  set), 
whenever  A  >  4. 

Now,  when  A  2  +  /5,  |f^(x)|  _>  1  for  all  x  in  the  invariant  set.  (See  the 
exercises.)  Thus,  there  can  be  no  attracting  set  for  f^,  and  hence  f  must  have 
sensitive  dependence  on  initial  conditons.  So  f^  is  chaotic-3  when  A  >  2  +  /5. 

In  fact,  is  also  chaotic-3.  (f^  and  are  "topologically  conjugate."  See 
II. 10.) 

We  will  now  discuss  the  physical  implications  of  our  criteria  for  chaos. 
Sensitive  dependence  on  initial  conditions  is  quite  plausible  physically  9ince  it 
precludes  an  attracting  set.  It  is  harder  to  rationalize  the  necessity  of  dense 
periodic  points.  But,  since  the  orbits  cannot  be  attracting,  knowing  that  there 
are  unstable  m-cycle  trajectories  intersecting  the  Poincare  section  doesn't  hurt. 
The  transitivity  says  that  there  is  a  trajectory  which  will  intersect  the 
Poincare  section  in  every  Interval,  which  is  certainly  a  type  of  irregularity. 

If  there  is  an  uncountable  scrambled  set,  that  shows  that  many  trajectories 
are  repeatedly  converging  and  diverging  along  the  Poincare  section.  That  this 
also  Implies  transitivity  lends  physical  credibility  to  the  chaos-s  definition. 

In  general,  it  is  not  easy  to  determine  If  a  return  map  is  either  chaotic-3 
or  chaotic-s.  One  usually  uses  numerical  techniques  to  see  if  it  might  be  chaotic 
and  then  conjectures  one  way  or  another.  See  section  11.10. 

Exercises . 

1.  Prove  that  if  A  _>  2  +  /5  then  |f^(x)!  >  1  on  its  invariant  set. 

2.  Prove  that  if  f  is  any  function  with  sensitive  dependence  on  initial  condi¬ 
tions,  then  f  cannot  have  an  attracting  set. 

.  Do  you  think  that  f^,  the  logistic  map,  can  be  chaotic  for  values  of 

A  <  2  +  /5?  Where  is  it  definitely  not  chaotic? 
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II. 7  Uni vfM  s ..lity — The  Bifurcation  Diagram 

First,  we'll  describe  how  to  interpret  a  bifurcation  diagram.  (Fee  page 
Fo.)  The  non-linearity  parameter,  X  for  the  logistic  map:  f^(x)  =  Xx(l-x),  is 
plotted  along  the  horizontal  axis.  The  attracting  set  for  that  particular  X  is 
plotted  along  the  vertical  axis,  which  runs  from  zero  to  one  for  f^. 

Thus,  for  1  <  X  <  3,  (X  -  1)/X  is  the  attracting  set  (1-cycle).  At  X  =*  3, 
this  bifurcates  to  give  an  attracting  2-cycle,  etc. 

Where  whole  intervals  seem  to  be  shaded  along  the  vertical  axis,  there  Is 
no  attracting  cycle,  hut  rather  attracting  intervals  (or  subsets  thereof). 

Notice  that  there  are  bands  of  attracting  cycles  (periodicity)  interspersed 
among  the  aperiodic  regions.  When  X  is  equal  to  4,  the  whole  Interval,  [0,1], 
is  shaded  and  chaos-3  is  in  effect.  The  shaded  areas  prior  to  this  do  not 
correspond  to  chaos-3  (since  chere  will  not  be  a  dense  orbit)  but  do  correspond 
to  a  weak  chaos  or  aperiodic  behavior.  (Weak  turbulence  in  fluid  dynamics.) 

We  will  present  universality  from  the  standpoint  of  the  bifurcation 
diagrams.  The  figures  in  this  section  may  be  helpful.  (Pages  98  to  101.) 

Our  first  discussion  will  center  on  the  constant,  5  “  4.6692016...  .  If 
we  denote  by  the  values  of  X  for  which  the  logistic  map,  f^(x)  “  Xx(l  -  x), 

has  an  attracting  2^-cycle,  then  will  be  an  Interval. 

For  example,  f^,  has  an  attracting  2-cycle  for  1  <  X  <  3,  so  Lq  *  (1,3). 
Similarly,  Lj  -  (3,  1  +  /6).  Define  ^  to  be  the  length  of  1^.  Then,  Mitchell 

Ai 

Feigenbaum  has  shown  that  iin  —  "6. 

i+"  *1+1 
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The  universal  aspect  of  6  is  that  Feigenbaum's  formula  will  hold  for  any 
system  with  a  bifurcation  diagram.  Essentially,  every  bifurcation  diagram  looks 
the  same  when  rescaled  along  the  horizontal  axis.  Thus,  the  cascading  of  2n- 
cycles  (or  any  bifurcating  cycles)  will  be  the  same  for  the  logistic  map  and  for 
the  experiment  with  a  heated  fluid. 

In  fact,  the  windows  in  the  bifurcation  diagrams  which  are  rescaled  and 

blown  up  in  this  section,  can  be  seen  to  be  essentially  the  same  as  well.  All 

bifurcating  cycles  do  so  at  the  same  rate  (in  the  limit). 

We  will  now  discuss  the  constant,  a  *  2.50290787...  .  Notice  that  on  the 

bifurcation  diagram  a  one-cycle  literally  splits  into  a  two-cycle,  then  each 

branch  of  the  two-cycle  splits  again  to  give  a  total  of  a  four-cycle,  etc. 

Denote  the  vertical  distance  between  the  two  branches  of  the  2-cycle  at  their 

point  of  bifurcation  as  .  Pick  a  pair  of  the  new  split  branches  in  the  4- 

cycle.  (It  doesn't  matter  whether  we  choose  the  upper  or  lower  pair.  But  the 

branches  of  the  pair  must  have  originated  from  the-  same  branch  of  the  2-cycle.) 

For  this  pair  of  branches,  denote  by  the  vertical  separation  when  each  one 

bifurcates  (to  give  an  8-cycle).  If  we  concinue  to  find  A  's  in  this  fashion, 

Ai 

then  Mitchel  Feigenbaum  also  showed  that  lim  - —  -  a.  This  fact  is  Independent 

i+-  A1+l 

of  which  branches  one  chooses,  il  only  depends  on  the  branches  bifurcating. 

The  universal  aspect  of  a  is  that  all  bifurcation  diagrams,  (for  any 
system),  are  now  essentially  the  same  when  rescaled  along  the  vertical  axis 
as  well!  The  combination  of  a  and  $  show  that  every  bifurcation  diagram  has 
essentially  the  same  rates  of  vertical  and  horizontal  accumulation. 

At  this  point,  we  will  describe  the  technique  for  general ■ ng  a  bifurcation 
diagram  for  t^x)  ”  Axil  -  x)... 
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Essentially,  we  would  like  to  graph  the  attracting  cycle  (if  it  exists) 


for  different  values  of  X.  Recall  that  the  cycle  is  attracting  if  —  f 11  (x^ )  | <  1, 
d  n_1  x 


and  that  —  fn(Xg)  =  II  f'tx^)  where  fx^, 


n- 1 


the  cycle  is  attracting  any  time  y  is  one  of  the  elements  of  the  n-cycle  since 


f’(y)  "  0,  implying  that  —  fn(xQ)  -  0  <  1. 


In  the  evolution  of  an  n-cycle,  (being  created  from  an  — cycle,  and  becoming 


a  2n-cycle),  the  n-cycle  will  go  from  weakly  attracting —  f^(x^)  *  1  — to 

stable,  to  weakly  attracting  again.  Essentially,  ~  f”  will  achieve  values  from 
1  down  through  0,  and  then  to  -1  when  it  bifurcates.  Thus,  —  will  be  an  element 
of  every  stable  n-cycle  in  the  bifurcation  diagram. 

For  this  reason,  we  use  y  as  the  starting  point,  (for  a  fixed  X),  and 
iterate  some  number  of  times,  say  up  to  f**^(-i).  Now,  If  there  is  an  attracting 
n-cycle  for  the  value  of  X  with  which  we're  working,  then  f^(y)  should  be 
"attracted"  to  it.  Thus,  we  plot  on  the  graph  f^+i(y)  for  i  equal  from  one  to 
50.  These  fifty  plotted  points  will  be  on  the  attracting  n-cycle  if  it  is 
present,  or,  they  will  bounce  around  in  some  attracting  set.  We  plotted  several 
thousand  points  in  the  diagrams  In  this  section  in  order  to  completely  (or 
partially)  shade  the  aperiodic  attracting  sets. 
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Figure  16 


"Figure  16  is  the  bifurcation  diagram  of  the  logistic  map  fx(x)  “  1  *  >' 

Values  of  X  between  1  and  4  are  plotted  along  the  horizontal  axis  and  the 
attracting  set  is  plotted  along  the  vertical  scale  which  is  from  0  to  1 . 

The  largest  "window"  in  the  predominantly  shaded  region  to  the  rlgnt 
rescaled  in  figure  17  to  show  a  bifurcating  3-cycle. 

This  same  figure  is  also  on  page  67." 


98 


"Figure  17  shows  a  3-cycle  bifurcating  into  a  6-cycle,  then  12-cycle,  etc. 

The  bifurcations  are  simultaneous  even  though  it  looks  as  if  the  upper 
branch  takes  longer  to  bifurcate.  This  is  because  of  the  resolution  of  the 
graphics. 

The  vertical  scale  is  still  0  to  1.  But,  X  is  now  between  3.8284  and  3.86 
along  the  horizontal  axis. 

The  largest  "window"  is  rescaled  in  figure  18.  It  is  a  9-cycle. 


Figure  18 


"Figure  18  is  a  rescaling  of  the  largest  window  in  figure  17.  The  vertical  axis 
is  also  rescaled  so  that  only  the  large  middle  window  is  visible,  and  hence  this 
looks  like  a  3-cycle,  but  is  just  j  of  a  9-cycle. 

X  is  tx-tween  3.85355  and  3.85415,  and  the  vertical  scale  is  between  0.4324 
and  0.5405. 

The  largest  middle  window  is  again  rescaled  in  figure  19." 


Figure  19 


"Figure  19  is  ^th  of  a  27-cycle.  The  values  of  X  are  between  3.854069  and 
3.854079.  The  vertical  axis  is  scaled  between  0.493754  and  0.506902. 

Notice  the  striking  similarity  between  figures  17,  18,  and  19.  Figure  18 
looks  like  the  vertical  mirror  image  of  figure  17,  and  figure  19  is  the  vertical 
mirror  image  of  figure  18." 


In  section  II. 6  we  presented  a  theorem  due  to  Sarkovskii.  Here  we  will  give 
Sarkovskii's  ordering  of  the  natural  numbers. 

Definition.  The  Sarkovskii  ordering  of  the  natural  numbers  Is: 

3  <  5  <  7  <  9...  <  2-3  <  2*5  <  2*7... 

<  22«3  <  22 *5  <  22.7  <  ...  <  23*3  <  23*5  <... 

<  ...  <  23  <  22  <  2  <  1. 

Thus,  one  first  lists  all  odd  numbers,  in  the  usual  order,  then  all  products 

2 

of  an  odd  number  and  2,  then  an  odd  number  and  2  ,  etc.  This  will  list  all  the 
natural  numbers  except  those  that  are  powers  of  2  (and  1).  List  these  powers  of  2 
last,  in  reverse  order. 

A  more  general  Sarkovskii's  theorem  is: 

Theorem.  Suppose  f:  R  ♦  R  is  continuous.  If  f  has  a  point  of  prime  period  k  and 
k  <  m  in  Sarkovskii's  ordering,  then  f  also  has  a  point  of  prime  period  m. 

Thus,  If  f  has  a  2-cycle,  f  will  also  have  a  1-cycle  and  if  F  has  a  3-cycle, 
f  will  have  an  n-cycle  for  every  value  of  n.  However,  this  theorem  doesn't  say 
the  cycles  are  attracting. 

For  example,  when  X  »  3.1,  f^  has  a  stable  2-cycle,  so  it  must  also  have  a 
1-cycle.  Well,  (X-l)/X  is  still  a  fixed  point  when  X  ■  3.1,  but  it  Is  repelling. 

So  when  X  ■  3.83  there  will  be  a  stable  3-cycle,  and  hence  an  n-cycle  for 
every  n.  But  for  thi8  X,  only  the  3-cycle  Is  attracting;  every  other  n-cycle  is 
repelling,  and  thus,  not  drawn  on  the.  bifurcation  diagram. 
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Exercises . 


1.  For  each  A  between  1  and  4,  find  the  range  of  f^. 

2.  For  each  A  between  1  and  4,  define  ^(A)  “  y,  gj(A)  -  f^(y)  *  T’  *2^  * 
fA^gl^X^’  etC*  Sh0W  that  g0^2^  ”  SjC2)  “  •**  “ 

3.  Show  that  whenever  y  has  period  n,  then  g^(A),  (as  in  prob  2),  is  tangent  to 
the  bifurcation  diagram  at  that  A. 

4.  Show  that  whenever  y  has  period  n,  then  gjCA),  (as  in  prob.  2),  is  tangent 
to  the  bifuraction  diagram  at  that  value  of  A. 

5.  For  A  >  2,  show  that  if  0  <  x  <  g~(A),  then  lim  f?(x)  >  g9(A)  and,  for  all  x» 

“  z  n+«  A  £ 

lim  fa(x)  S.  where  g^  and  g ^  are  as  in  problem  2. 

n+« 

6.  If  g^  is  as  in  problem  2,  what  can  be  said  about  each  g^(A)  for  those  A 
where  y  is  an  element  of  some  n-cycle? 
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II. 8  Higher  Dimensions 

A 

When  we  use  a  one-dimensional  Poincare  section  there  are  two  types  of  bifur¬ 
cations  which  the  return  map  can  display.  The  one  we  looked  at  in  section  II. 8 

dfn 

was  a  period-doubling  bifurcation,  and  this  occurs  when  (x^)  ■  -1,  (where  Xq 

is  any  point  In  an  n-cycle). 
df" 

When  (xq)  =  1,  the  return  map  goes  through  a  saddle-node  bifurcation. 
Essentially,  a  saddle-node  attracts  points  from  one  side  while  repelling  points  on 
the  other  side.  For  example,  h^(x)  “  eX  -  X  goes  through  a  saddle-node  bifur¬ 
cation  as  X  increases  through  1. 

In  a  phase  space  of  dimension  greater  than  two,  we  will  probably  be  using  a 
Poincare  section  of  dimension  larger  than  one.  Thus,  the  return  map  is  not  a 
function  of  one  variable,  but  rather  of  several  variables.  The  types  of  bifur¬ 
cations  that  can  occur  (both  in  the  phase-space  and  on  the  Poincare  section)  are 
varied.  They  include  analogies  of  the  period-doubling  and  saddle-node  bifurcations 
as  well  as  others,  the  most  common  of  which  is  the  "Hopf  bifurcation". 

As  an  example  of  the  type  of  dynamics  possible,  we'll  give  a  brief  treatment 
of  the  Horseshoe  map,  due  to  Smale. 

Example  1.  The  Horseshoe  map  takes  the  figure  drawn  into  itself  by  stretching, 
contracting  and  bending: 
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This  map  works  on  a  2-dimenslonal  region  in  the  plane  and  maps  it  into 
itself*  We've  defined  it  geometrically  because  it  is  easier  to  work  with  that 
way. 

Since  the  Horseshoe  map  shrinks  (and  stretches)  the  set  into  a  subset  of 

Dj ,  it  is  a  contraction  mapping,  and  thus  has  a  unique  fixed  point  in  D  .  Also, 

all  points  in  are  mapped  into  a  subset  of  D^;  so,  for  every  point  x  t  D^  U  D2» 

lira  fn(x)  ”  Xq  where  x^  is  the  unique  fixed  point  of  f,  the  Horseshoe  map,  in  Pj. 
n-*"» 

Many  of  the  points  in  S  will  also  be  mapped  into  D^  and  thus  iterate  towards 
Xq  as  well.  But  there  is  a  two-dimensional  Cantor-type  set  in  S  which  is  invar¬ 
iant.  That  is,  the  Horseshoe  map  leaves  this  2-dinensional  Cantor-type  set  fixed. 

Points  in  this  invariant  set  can  be  shuffled  around  by  the  map,  but  will 
always  remain  inside  it.  This  is  exactly  analogous  to  the  logistic  map,  f^,  when 
X  >  4.  There,  we  had  a  one-dimension  1  set  which  was  invariant.  (Also  for 

the  tent  map,  g^,  when  X  >  2.) 

Next  we'll  look  at  a  function  :  Igebraically  called  the  Henon  map. 

2  2  2 
Example  2.  Define  Ha  j,:  R  *  R  by:  '•  )  »  (a  -  by  -  x  ,  x) . 

2  2 

Thus,  points  in  R  are  mapped  t  aints  in  R  .  There  is  an  analogy  to 

hyperbolicity  of  one-dimensional  fun  ich  relies  on  full  derivatives  of 

mult i-dimen8ional  functions: 
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Thus,  DH(x,y)  =  |  ^  0  |  * 

The  Jacobian  of  H  is  simply  the  determinant  of  the  derivative  of  H,  | DH |  *=  b. 

H  Is  hyperbolic  so  long  as  |b|  *  1.  When  b  =  0,  H  is  no  longer  dependent  on 

2 

y,  and  Is  essentially:  H  (x)  *  a  -  x  ,  which  is  analogous  to  the  logistic  map. 

a 

When  b  *  0,  we  can  algebraically  find  the  inverse  of  H  to  obtain: 


,ra,b(X’y)  =  (y* 


-)  which  looks  quite  similar  to  H  itself. 


We  will  trv  to  find  the  fixed  points  of  H  ,  assuming  that  0  <  I b I  <  1: 

a ,  b 

First,  set 

2 

(x,y)  -  (a  -  by  -  x  ,  x), 

2  2 

which  implies  x  =  y  and  x»a-hx-x,orx  +  (1  +  b)  x  -  a  =  0.  Thus,  this  has 

2 

real  solutions  if  and  only  if  (1  +  b)  +  4a  0. 

-12  -12 
So,  when  a  <  — (1+b)  ,  there  are  no  fixed  points;  when  a  “  ~t( 1  +  b)  ,  there 

- 1  -12 

is  one  fixed  point  at  x  -  —■(  1  +  b);  and  when  a  >  — O  +  b)  ,  there  are  two  fixed 


points  at:  x 


+  b)  +  /(I  +  b)2  4a 


-(1  +  b)  -  /(I  +  b)2  +  4a 
and  x  - - 2 - •  Note 


that  the  y-coord inates  of  all  these  points  are  the  same  as  the  x-coordinates  by  our 
substitutions. 

-1  2 

The  critical  value  of  a,  a  ,  ,  is  -r( 1  +  b)  .  On  the  line  y  =  x,  we  have 

c  r  i  t  4 

has  no  fixed  points  of  H  when  a  <  a  .  ,  then  1  fixed  point  for  a  =  a  ,  and 
'  a  ,b  crit  crit’ 

then  2  fixed  points  for  a  >  a  .It  turns  out  that  of  these  two  fixed  points, 

crit 

one  is  a  saddle  point  and  the  other  is  (sometimes)  attracting.  Thus,  as  a 
increases  through  acrjt«  a  sac'dle-node  bifurcation  occurs.  As  a  increases  further, 
one  of  the  fixed  points  bifurcates  into  a  period-2  point.  This  is  a  period- 
doubling  bifurcation. 

The  dynamics  of  the  Henon  map  get  very  complicated.  See  An  Introduction  to 


Chaotic  Dynamical  Sytems  for  further  details. 
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"Strange  Attractors"  are  quite  common  for  higher  dimensional  return  maps. 
When  a  ■  1.4  and  b  =  -0.3,  the  Henon  map,  Hg  seems  to  have  one.  Strange 

attractors  are  attracting  sets  for  a  return  map  which  display  fractal-type 
properties.  There  are  strange  attractors  imbedded  in  3-dimensional  toroidal 
figures  for  some  systems,  and  the  bifurcation  diagram  itself  is  a  type  of 
strange  attractor.  This  is  a  nice  relationship  between  fractals  and  chaos: 
dynamical  systems  can  generate  fractal  sets.  For  example,  an  IFS  is  a  type 
of  dynamic  system.  Also,  fractal  sets  display  "chaotic  organization"  to  the 
average  observer. 

Higher  dimensional  dynamics  is  still  a  frontier  for  researchers  and  there 
are  many  unsolved  problems:  both  specific  ones  and  general  ones. 


f 


II. 9  Complex  Dynamics 

Because  of  the  elegant  theory  of  complex  numbers,  dynamics  which  occur  in 

2 

R  are  often  interpreted  to  lie  in  the  complex  plane.  We'll  spend  most  of  this 
section  discussing  the  Mandelbrot  set,  which  is  a  parameter  space  map  for  a 
simple  dynamical  system  in  complex  variables. 

1 6 

First,  recall  that  a  complex  number  can  be  represented  as:  a  +  ib  or  re  , 

2 

where  a,  b,  r,  and  0  are  real  and  i  «*  -1.  When  graphing  complex  numbers  the 
number,  a,  goes  on  the  x-axis  (the  real  axis)  and  the  number,  b,  goes  along  the 

y-axis  (imaginary  axis).  Plotting  a  +  ib  is  the  same  as  plotting  (a,b).  The 

16  16 
form,  re  ,  is  analogous  to  polar  coordinates  since  e  ■  cos  0  +  i  sin  0.  That 

L  0 

is,  to  graph  re  ,  just  graph  (r,0)  in  the  polar  plane. 

To  mulitply:  (a  +  ib)(c  +  id)  »  ac  -  bd  +  i(ad  +  be),  and  (  re*0  )  (qe  ) 

■  rqel^8+^.  A  multiplicative  inverse  of  a  +  ib  is  — ~rr  M  A: — ,  since 

a  +  ib  2  2 

2  2  D 

(a  +  Ib)  •  [  — -.A  -  -y~  ~2  ”  !*  (assuming  a2  +  b2  *  0). 

\a"  +  b  J  a  +  b 

/  2  2 

The  modulus  of  a  complex  number,  z  ■  a  +  ib,  is  |z|  ■  |a  +  Ib |  ■  /  a  +  b  . 
10 

If  z  *  re1  ,  then  |z|  =  jrj,  which  is  the  distance  from  the  complex  number,  z, 
to  the  origin,  0=0+  Oi. 

Before  we  present  the  algorithm  for  the  Mandelbrot  set,  we'll  look  at  its 
real  number  analog. 

2 

Example  1.  Define  h^(x)  *»  x  +  c.  Show  that  h^  has  essentially  the  same 
dynamics  (as  a  return  map)  an  the  logistic  map,  f^,  for  appropriate  values  of 
X  and  c. 


i 
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First,  we'll  choose  1  <  A  <  4  and  let  c  *  ^(2  -  A),  so  that  A  »  1  +  /I  -  4c. 

Now  define  the  linear  function,  g(x)  "  ax  +  b,  where  a  =*  — ~  and  b  =  Then 

g  0  hc  »  f^  •  g,  or  g  °  hfi  0  g  •  f^.  This  relationship  between  h^  and  f ^  is 
called  topological  conjugacy .  It  is  analogous  to  two  matrices  being  similar  (and 
thus  having  the  same  eigenvalues).  It  is  easy  to  verify  that  hc  duplicates  the 
dynamics  of  f^(as  *  goes  from  one  to  four)  as  c  goes  from  ■—  to  -2.  (See  the  exer¬ 
cises  . ) 

One  way  to  check  this  Is  to  notice  that:  (g°hc°g  )  “g°h  •  g 

Thus,  f”  *  g  «  h"  °  g  and  g  •  f”  ®  g  ■  h".  So,  If  Xq  Is  a  point  of  period  n 

for  t,,  then  g  *fx,,)  is  a  point  of  period  n  for  h  .  Also, 

A  U  C 

~  h™(g  ^(xg))  *  —  f”(xg),  which  shows  that  the  dynamics  of  the  two  functions  are 
the  same  for  all  attracting  cycles. 

If  we  were  to  make  a  bifurcation  diagram  of  hc ,  then  we  would  choose  zero 
as  the  point  to  iterate,  since  it  will  be  present  as  a  periodic  point  in  all 
stable  n-cycles.  (Just  as  y  was  present  in  all  stable  n-cycles  for  f^.) 

Therefore,  h^  (which  goes  through  a  saddle-node  bifurcation  for  c  *  (just 

1  -3 

like  f ^  does  when  A  *  1)  has  an  attracting  fixed  point  for  c  between  -j-  and  — an 

-3  -5 

attracting  2-cycle  for  c  between  — and  — £,  etc;  with  chaos-3  at  c  *  -2. 

We’ll  now  develop  the  algorithm  to  construct  the  Mandelbrot  set. 

2 

Example  2.  Define  H  (z)  •  z  +  c  to  be  a  complex-valued  function  of  the  complex 

~~  c 

variable,  z.  The  nonlinearity  parameter,  c,  is  also  complex  valued. 

For  each  value  of  c,  we  determine  whether  the  orbit  of  zero  (a  critical  point 
as  in  example  1)  will  converge  to  infinity. 
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If  the  orbit  does  not  go  to  «,  then  c  is  defined  to  be  in  the  Mandelbrot  set, 

M.  So 

M  =  {c  e  C:  11m  Hn(0)  *  «}, 
c 

n+® 

where  C  is  the  set  of  all  complex  numbers. 

It  is  easy  to  check  that  zero  is  in  M,  since  if  c  ■  0,  then  Hq(0)  -  0  for 

2 

every  n.  Similarly,  one  is  not  in  the  Mandelbrot  set,  since,  (0)  **  1,  Hj(0)  «  2, 
3 

Hj(0)  «  5,  ...  which  converges  to 

It  turns  out  that  if  there  is  an  n  so  that  |H^(0)|  >  2,  then  c  will  not  be  in 
the  Mandelbrot  set. 

On  the  real  axis  between  and  -2,  has  the  same  dynamics  as  h^  in  example 

1.  Thus,  the  real  numbers  from  to  -2  are  all  contained  in  the  Mandlebrot  set. 

The  points  not  in  the  Mandlebrot  set  form  what  is  known  as  a  Julia  set.  The 

boundary  of  the  Julia  set  is  the  same  as  the  boundary  of  the  Mandelbrot  set.  The 

Mandelbrot  set  is  a  map  in  parameter  space.  It  describes  what  parameters  give 

zero  a  bounded  orbit  under  F  .  The  dynamics  of  F  in  the  complex  plane  (not 

c  c 

parameter  space)  are  completely  different.  There  are  many  possibilities  for  coming 
up  with  interesting  pictures. 

Other  examples  can  exhibit  multiple  strange  attractors,  their  corresponding 
basins,  and  an  invariant  set  all  for  the  same  complex  function!  By  using  different 
coloring  schemes,  the  computer  graphics  generated  by  these  functions  can  be  amazing 
and  appear  frequently  on  book  covers  and  in  magazine  articles. 
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Exercises 


1.  Verify  the  second  paragraph  In  example  1. 

2.  By  writing  z  -  x  +  iy,  write  Hc(z)  as  a  function  of  x,y  ...  H^(x,y)  “  (H*,  H 

1  2 

where  F  and  F~  are  real-valued  functions  of  x  and  y.  (Let  c  ■  c^  +  ic^*) 

4  3 

3.  Investigate  the  dynamics  of  the  real-valued  function  f  (x)  *  tx  +  cx  for 

c  J 

c  c  R. 

4.  Using  problem  3,  what  can  you  say  about  the  complex  dynamics  of 

/V  4  3 

F  (z)  “  -rz  +  cz. 
c  3 
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II. 10  Randomness 


We  have  often  referred  to  chaotic  behavior  as  being  unpredictable.  A 
chaotic  physical  system  is  one  which  is  going  through  seemingly  irregular 
motion.  Even  though  we  have  very  precise  definitions  of  chaotic  functions 
(chaotic-3  and  cbaotic-s),  they  are  based  on  characteristics  which  imply  a  kind 
of  randomness. 

We  will  now  quote  some  references  on  the  definition  of  random: 

1.  From:  An  Introduction  to  Information  Theory.  Pierce.  "Random: 
Unpredictable." 

2.  From:  An  Encyclopedic  Dictionary  of  Mathematics.  "Practically,  random 
numbers  are  those  that  are  generated  by  complex  finite  algorithms  that 
produce  a  finite  sequence  of  numbers  that  have  no  apparent  regularities  and 
are  not  rejected  by  tests  of  typical  statistical  hypotheses  on  independence, 
uniformity,  and  goodness  of  fit." 

3.  From:  Mathematics  Dictionary,  4th  ed.,  James/James.  "Random  Sequence:  A 
sequence  that  is  irregular,  nonrepetive  and  haphazard. . . .  A  completely 
satisfactory  definition  of  random  sequence  is  yet  to  be  discovered." 

4.  A  paraphrase  of  Andrei  Kolomogorov  (who  laid  the  foundations  for  modern 
probability  theory  in  1933):  A  finite  sequence  is  random  if  the  shortest 
algorithm  which  can  generate  it  is  of  the  same  approximate  length  as  the 
finite  sequence. 

Mark  Kac  was  a  famous  mathematician  who  used  to  give  very  popular  talks  on 
"randomness."  His  thesis  was  that  there  is  no  statistical  definition  of  random- 
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ness.  He  claimed,  (correctly),  that  given  any  statistical  test — such  as  those 
mentioned  at  the  end  of  the  second  quote — there  is  an  algorithm  which  will 
generate  pseudorandom  numbers  that  pass  that  statistical  test. 

In  other  words,  if  you  know  that  a  statistician  is  going  to  run  some 
analysis  techniques  on  data,  you  can  give  him  two  sets  of  data:  one  set  is 
generated  by  what  we  commonly  think  of  as  a  random  process — such  a6  a  scatter 
pattern  of  arrows  on  a  target — and  the  other  set  is  generated  by  a  deterministic 
algorithm.  The  statistician  will  not  be  ahle  to  tell  if  either  set  of  data  is 
"truly  random". 

It  should  be  noted  that  although  probablity  and  statistics  seem 
inextricably  connected  to  randomness,  the  foundations  of  both  subjects  rely  on 
"random  variables",  which  are  essentially  just  normal  everyday  functions.  A 
"random  sample"  is  usually  meant  to  connote  a  theoretical  "random  sequence"  and 
is  defined  in  such  a  way  as  to  make  the  theory  progress  smoothly.  However,  the 
statistical  tests  which  try  to  verify  this  type  of  randomness  are  inconclusive. 
This  does  not  lessen  the  utility  of  probability  or  statistics — they  have  proven 
themselves  time  and  again  in  such  diverse  areas  as  gambling  and  quantum 
mechanics — it  merely  points  out  that  "random"  might  be  a  term  so  basic,  that  it 
defies  definition.  This  thought  is  echoed  in  the  third  definition. 

Finally,  we  need  to  peruse  Kolomogrov's  definition.  A  full  treatment 
would  involve  some  theoretical  computer  science,  so  we'll  stick  to  practi¬ 
calities.  It  is  theoretically  possible  to  find  the  algorithm  which 
generates  psuedorandom  numbers,  but  it  is  Impossible  in  practice.  Actually,  it 
is  Just  as  likely  that  an  algorithm  will  be  found  to  generate  a  "truly  random" 
seq uence. 
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But  f(x),  the  logistic  map,  will  Iterate  a  point  in  the  interval  [0,1]  in  a 
seemingly  random  fashion  with  few  exceptions.  (Zero,  one-half,  and  one,  as  well 
as  the  inverses  of  one-half  will  all  Iterate  to  zero.)  Of  course,  if  we  just 
pick  a  point,  say  —  ,  and  print  its  orbit,  it  is  obviously  not  random.  If  we 

IT 

denote  {fn(-^)}  n^Q  by  fxg,  Xj  ,  x2 , . . . , xN }  where  *0  *  ~  >  xj  -  f(^),  etc.,  then 
a  plot  of  the  points  (x^ ,  x^+1 )  in  the  xy-plane  will  give  good  graphical  evidence 
that  this  sequence  is  highly  correlated.  This  is  obvious:  each  x^  *  f(xi_1>, 
the  graph  will  fill  in  points  on  the  curve  of  y  *  f(x). 

Being  a  bit  more  clever,  we  could  choose  a  number,  n,  and  let  each 
x^  =  fn(Xj_j).  For  a  value  of  n  greater  than  the  number  of  significant  digits 
carried  by  one's  calculator  or  computer,  a  graphical  plot  of  (x^,  x^+^)  will  no 
longer  fit  on  an  obvious  graph,  and  thus  roundoff  error  will  destroy  the  actual 
correlation.  (This  is  brought  on  by  sensitive  dependence  to  initial  conditions.) 

Frequency  plots  of  one  thousand  pseudoranaom  numbers  generated  in  this 
fashion  will  fit  a  beta  distribution  whose  parameters  are:  a  ■  b"  y.  The 
sane  a  and  b  work  for  any  choice  of  n.  The  beta  distribution  is  rather  obscure, 
being  used  mostly  for  curve  fitting  and  prior  distribution  in  Bayesian  statistics. 
It  is  lucky  that  a  ■  b  ■  y  is  one.  of  the  few  cases  in  which  the  cumulative 
distribution  can  explicitly  be  found: 
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(1)  The  p.d.f.  is: 


b(x;  -|) 


dx 


x-x 


for  0  <  z  <  1 


otherwise. 


(2)  The  c.d.f.  is: 

10  ,  if  x  <  0 

-jf  [Arc  sin(2x  -  1)  +  y],  if  0  <  x  <  1 
1  ,  if  x  >  1. 

Using  the  fact  that  if  X  is  a  random  variable  with  c.d.f.  F,  then  F(X)  is  a 
random  variable  with  a  uniform  distribution  on  the  interval,  [0,1],  we  can 
transform  our  pseudorandom  numbers  into  pseudorandom  numbers  with  a  uniform  dis¬ 
tribution  on  [0,1]  by  letting  y±  -  B(xf;  y, 

Amazingly,  the  numbers,  yi>  are  iterates  of  the  tent  map!  That  is  the  tent 
map  is  a  theoretical  uniform  random  number  generator  and  the  tent  map  and  logistic 
map  are  topologically  conjugate.  (See  II. 9.)  That  is,  B  »  f  »  b'1  -  g  where  a"1 
is  the  inverse  of  the  cumulative  beta  distribution. 

The  gist  of  this  discussion  is  that  chaotic  behavior  really  is  "random".  In 
the  eyes  of  the  observer,  any  sequence  of  pseudorandom  numbers  is  truly  random  if 
the  observer  doesn't  know  how  to  duplicate  them,  or  at  least  know  what  algorithm 
was  used  to  generate  them.  Thus,  randomness  is  subjective. 
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S  SHAPES 


The  practical  fractal 


It  k  no  accident  that  the  inventor  of  fractal  geometry,  Dr  Benoit 
Mandelbrot,  works  for  IBM.  Hit  new  science  is  a  chi!;  of  the  computer  age. 
Without  the  calculating  power  to  explore  its  weird  avenues,  and  electronic 
pictures  to  fire  the  imagination,  fractal  geometry  would  have  remained  a 
mathematical  oddity.  Instead,  k  may  overtake  Euclid 


a 

k 


BETWEEN  the  late  1950*  and  the  early 
1970k  Dr  Mandelbrot  invented  a 
branch  of  mathematics  that  can  describe 
and  analyse  the  irregularity  of  the  natural 
world.  The  key  to  his  theory  is  a  type  of 
shape  that  he  called  a  fractal  The  descrip- 
tive  power  of  fractals  was  soon  evident. 
Fractal  forgeries — s  type  of  computer-genet- 
and  picture— of  clouds,  mountains  and 
cnuclmes  bear  an  uncanny  resem¬ 
blance  to  the  real  thing.  But  pretty 
pictures  *re  not  enough  to  overthrow 
Euclid.  Now.  12  years  after  Dr 
Mandelbrot  wrote  his  book,  ‘The 
Fractal  Geometry  of  Nature",  the  evi¬ 
dence  that  fractals  can  shed  light  on  a 
wide  variety  of  problems  is  piling  up. 

The  applied  fractal  has  arrived. 

Fractals  are  shapes  that  look 
more  or  less  the  same  on  all  or  many, 
scales  of  magnification.  Consider  a 
coastline,  the  most  obvious  example 
of  a  fractal  in  nature.  Maps  of  coast¬ 
lines  drawn  on  diffeient  scales  all 
show  a  similar  distribution  of  bays 
and  headlands.  Each  bay  has  its  own 
smaller  bays  and  headlands,  ad  (al¬ 
most)  m/tmtvm.  The  same  general 
structure  can  be  seen  in  the  magnifi¬ 
cent  sweep  of  the  Gulf  of  Mexico,  the 
Bate  de  la  Seine,  the  Pendower  Coves 
neat  land's  End.  the  pp between  two 
rocks  on  the  foreshore  «  Acapulco, 
trvd  so  on  down  to  the  individual  in¬ 
dentations  of  a  single  rock.  Coastlines  are 
crinkly  however  close  to  them  you  get. 

A  mathematical  shape  that  shares  this 
property  with  coastlines  it  the  Koch  snow¬ 
flake,  in  which  the  bays  and  headlands  are 
successively  diminishing  equilateral  triangles 
(see  diagram).  Nature  does  not  sculpt  coast¬ 
lines  from  triangles,  but  the  Koch  mowfiake 
does  capture  one  feature  of  coasttoes  wtlL 
A  tiny  piece  of  coastline,  magnified  ten 
'imes,  still  looks  like  a  coastline;  the  same 
goes  for  any  part  of  the  snowflake.  Such  ob¬ 
jects  are  said  to  be  "self-similar". 

Not  to  the  fstrulisi,  shapes  of  oid-faih- 


ioned  geometry,  which  lore  their  structure 
when  magnified.  For  example,  the  surface  of 
a  large  sphere  appears  almost  flat  when 
viewed  dose  up,  which  is  why  plenty  of  peo¬ 
ple  used  to  think  the  earth  itself  was  flat. 

Traditional  geometry  has  to  ignore  the 
crinkles,  whorls,  squigglet  and  billmes  of  the 
real  world  because  they  are  irregular  and  so 
do  not  submit  to  ecandard  mathematical  for¬ 
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mulae.  The  notion  of  self-similarity  lets 
fractal  geometers  see  a  ion  of  order  in  the 
apparent  chaot  of  these  shspet.  It  lets  them 
Quantify  the  roughness  and  irregularity  of  a 
snipe  and  give  it  a  numerical  value,  known 
as  its  fractal  dimension. 

Dimensions  are  usually  thought'  of  at 
whole  numbers.  A  tine  it  one-dimensional  s 
square  twodtmtntional,  a  cube  three-di¬ 
mensional.  But  fractal  dimensions  are  not 
whole  numbers:  the  Koch  snowflake  has 
1.2618  dimensions,  the  coastline  of  Britain 
has  around  1.2S  dimensions.  The  best  way 
to  understand  this  is  not  to  wony  about  it. 

17 


When  mathematicians  talk  about  fractal 
"dL.-sensions",  they  are  not  using  the  term  in 
its  ordinary  sense.  Roughly  speaking,  if 
something  has  more  than  one  bin  leu  than 
two  fractal  dimensions  it  is  better  at  filling 
up  space  than  is  an  ordinary  one-dimen¬ 
sional  object  (such  as  a  line),  but  not  quite  so 
good  as  a  two-dimensional  one  (such  as  a 
surface).  A  crinkly  line  of,  say,  1.25  dimen¬ 
sions  is  better  at  filling  up  space  than  a  one- 
dimensional  straight  une  because  you  need 
more  ink  to  draw  the  crinkle  than  you  do  to 
draw  the  straight  tine.  A  line  of  1.26  dimen¬ 
sions  is  even  crinklier  and  needs  even  more 
ink.  Some  fractal  curves  are  so  wiegty  and 
detailed  that  they  fill  up  nearly  all  ofthe  sur¬ 
face  they  are  drawn  on.  So  they  come  within 
a  whisker  of  qualifying  as  surfaces— «e,  as 
twodimcnstonal  That  is  the  crude  idea  be¬ 
hind  fractal  dimensions. 

Armed  with  a  technique  for  measuring 
the  irregularity  of  shapes,  the  theory  of 
fractals  has  now  been  applied  to  protein 
structure,  acid  rain,  earthquakes,  the 
fluctuation  of  exchange  rates,  oil  ex¬ 
traction,  epidemics,  corrosion,  brittle 
fractures,  music,  the  distribution  of 
galaxies,  the  level  of  the  Nile:  and  the 
shapes  of  clouds,  trees,  lakes  and 
mountains.  Nearly  every  branch  of 
science  studies  something  that 
fractals  can  help  with,  because  all  as¬ 
pects  of  nature  involve  some  rough¬ 
ness  and  irregularity. 

Superficial  science 
Begin  with  surfaces.  The  shape  of  sur¬ 
faces  is  significant  throughout  sci¬ 
ence.  When  antibodies  bind  to  a  vi¬ 
rus,  or  enzymes  ro  a  molecule  of  DMA, 
they  do  so  because  of  some  afmiry  for 
the  particular  shape  of  surface  in¬ 
volved.  Chemical  catalysts  used  in  in¬ 
dustry  work  by  causing  reactions  to 
occur  on  surfaces.  Metallurgists  worry 
about  the  form  of  fracture  suffices  in 
metals.  Geologists  do  much  the  same 
for  mountain  ranges.  The  same 
shapes  may  occur  on  many  scales:  high- 
powered  microscope  pictures  of  the  surface 
of  silicon  look  rather  like  the  Grand 
Canyon. 

Shapes  in  nature  are  usually  neither  en¬ 
tirely  regular  nor  entirely  random.  To  con¬ 
struct  theories  of  how  materials  behave, 
these  shapes  must  be  simulated  mathemati¬ 
cally,  either  on  paper  or  by  computer. 
Fractals  are  the  perfect  tool  for  the  job  be- 
caure  they  have  the  right  mixture  of  struc¬ 
ture  and  irregularity.  Computer  models 
famed  on  fractals  can  explore  how  physical 
properties  of  a  material  vary  under  different 
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condition*:  how  clay  flow*  under  pressure, 
for  example. 

tn  i960  Dr  Harvey  Stapleton  at  the  Uni- 
vertity  of  Illinois  at  Urban*  inveatigated  the 
mrenetic  propertia  of  iron-bearing  protein 
molecules.  If  a  crystal  a  placed  in  a  magnetic 
field,  which  i*  then  removed,  it  lose*  it*  mag¬ 
netic  propernea  in  a  characteristic  fashion. 
This  "relaxation  rate'’  can  be  quantified;  for 
perfect  crystal*  it  is  always  three.  This  can  be 
explained  mathematically!  a  crystal  it  a 
threedimeraionalobfecr  and  the  relaxation 
rate  it  equal  to  the  dimension.  For  protein*, 
though,  Dr  Stapleton  obtained  pueding  re¬ 
laxation  rate*,  such  a  1.7. 

He  showed  that  the  solution  to  the  pu> 
tie  lay  in  the  geometry  of  (he  moleeuiea.  A 
typical  protein  molecule  iee  long  chain  of 
ammo  acids,  folded  and  crumpled  in  a  meet 
irregular  way.  The  crumpling  h  fractal— it 
keeps  its  structure  scrota  a  wide  range  o f 
scales-  and  the  relaxation:  cere  cair  be  core 
puted  from  ia  fractal  dunenaion.  be  fact,  dir 
two  are  equal.  So  the  abwract  concept  of 
fractal  dimension  paye  oC 

Or  Douglas  Rees  at  the  Lfruventry  at 
California  at  Los  Angelas  and  his  coSsbota- 
ton  have  shown  that  protein  surfeeaa— for 
example,  the  Miriam*  of  haemoglobin, 
which  transports  oxygen  bv  the  blood  ere 
fractal.  Using  computer  analysis  of  the  way 
x-raya  are  scattered  when  they  hit  haemoglo¬ 
bin,  they  found  that  the  surface  of  that  pro¬ 
tein  hat  a  fractal  dimention  of  around  2.4. 
This  suggests  that  the  surfaces  an  very 
rough,  rather  Uke  a  crumpled  paper  ball.  (If 
you  take  a  piece  of  paper  the  site  of  this 
page,  crumple  it  in  your  fisc  and  then  lac  go, 
the  resulting  offke-otiaik  has  a  fractal  di¬ 
mension  of  2.5.) 

Dr  Rees  also  found  that  some  region*  of 
a  protein's  surface  an  smoother — that  it, 
have  a  smaller  fractal  dimention—  *h*n  oth¬ 
ers.  Thu  turns  out  to  be  a  quite  a  help  for 
btocf  irmical  engineers  Like  velcro,  proteins 
trick  together  best  where  their  surfaces  are 
roughest.  And  smotxher  regions  teem  to  be 
where  enrymet,  which  control  the  stay  mole- 
cVes  function,  do  their  work.  By  measuring 
the  fractal  dimension  of  a  procam  molecule's 
surface,  the  rough  can  be  sorted  from  the 
smooch  in  a  precise  way.  Such  tachniqust 
could  help  in  the  desqpi  of  synthesised  pro 
ein  motorola  for  new  drup  because  they 
should  be  able  to  pinpoint  the  active  arts 
where  etuymawifl  be  able  to  work. 

SoriaUi  partkiaa 

Soot  a  soft  and  crumbly  because  if  consists 
of  a  loosely  knit  agpiprion  of  carbon  parti- 
cits  S  toiler  tons  of  mucky  aggregation  are 
founc  inside  batteries  as  they  corrode,  in  -he 
procett  of  electroplating,  and  elsewhere.  In 
196),  Dr  Thomas  Witten  at  Exxon  labora¬ 
tories  in  Clinton,  New  jeney,  trri  Dr  Leon¬ 
ard  Sander  from  ths  Universe  of  Michigan 
*t  Ann  Arbor  found  a  new  way  of  looking  at 
ho-*  such  deposits  build  up,  a  math  -vital 


model  known  at  Difusion  Limited  Aggrega¬ 
tion  (dlA  In  -.he  ola  model,  tingle  pertides 
spread  out  in  what  mathematicians  call  a 
random  walk;  chat  is,  every  so  often  they 
move  a  certain  distance  in  a-  random  direc¬ 
tion.  They  continue  this  diffusion  until  they 
collide  with  a  powsng  smudge  where  others 
have  already  hit  and  then  stick  to  it.  - 
Simulations  of  this  process  on  a  com¬ 
puter  screen  produce  branching  shape*  like 
irregular  ferns,  with  a  fractal  dimension  of 
1.7.  Similar  random  walk*  in  three-dimew- 
sional  space  lead  to  fractal  dust  ere  with  a  di¬ 
mension  of  roughly  2.5.  The  dla  model  has 
mad*  it  possible  to  srudyse  and  meaaure 
many  kinds  of  fractal  ifegarion 

DrJmwMar  andhascotWagaasat  mt 
Univarairy  of  Oslo  have  applied  fcactak  to 


Mandelbrot,  king  of  ahapaa 


immunoglobulin  clusters,  lmmwnogiobuline 
are  proteins  and,  like  i  poached  egg,  tend  to 
stick  together  when  heated  up.  But  what  ex¬ 
actly  make*  them  stick  together)  Why  don’t 
they  crumble  away?  Knowing  the  fractal  ii- 
mension  of  tuch  dusters  provides  nr.  tspnr- 
mental  tool  for  working  out  here  to  ferJd 
them  up  in  the  firsr  place.  By  nmulating  the 
aggregation  of  particles  you  can  we  which 
pruccares  lead  tn  the  right  sort  cf  shape.  1'iie 
pvj*  a  way  to  compare  there*  with  cxien- 
ment.  Before  fractals  were  invented,  uttie 
quantirsnvt  work  could  be  dene  on  the  way 
particles  pits  up  a*  deposits  fores. 

Another  process  that  predwa  reniiar 
branchiftf-trevdriJ  shapes  »  knew*  si  vis¬ 
cous  fingering.  The*  has  been  studied  for 
quite  some  time,  but  oil  companies  would 
Uke  to  understand  it  better.  in  order  tc  ex¬ 
tract  oil  from  a  well,  water  is  pumped  in  un¬ 
der  preasura.  The  oil  is  then  pusheci  cur  be- 
rauee  oil  and  water  do  r«  mix.  But  the  react 
pah  followed  by  the  »t rot  <r  it  fir-re 
through  the  oil  it  ex tfcfr»+-  cow.  N<*ted.  A 
better  «>nderst*.'.4i-g  of  e*  iw-iris  t.id  eddvrt 
should  make  it  o't:'  4  w  tuiieen  .-tore  od 


our  of  the  wells.  __  - 

The  usual  way  to  *tudy  this  problem  of 
flow  uses  an  apparxrus  known  as  s  Hele- 
Shaw  cell:  two  flat  glass  plates  with  a  thin 
layer  of  oil  sandwiched  in  between.  Water  is 
fed  in  through  a  hole  in  the  middk  of  one 
glaat  place:  At  firm  the  water  spreads  out  ins 
circular  dire;  but  a*  tha  disc  grows,  an  incon¬ 
veniently  complicated  “dynamic  instability” 
sets  in.  The  boundary  between  oil  and  water 
gow*  bumps,  which  in  turn  grow  into  “fin¬ 
ger*’’ that  penetrate  the  oil  in  attar-tike  pat¬ 
tern.  These  fingere  repeatedly  break  up  in 
the  same  way,  sphering  at  the  tip*  when  they 
get  too  wide:  Use  result  it  a  repeated  blanch¬ 
ing  gowthtwtfaarlik*  a  jjretio^^ phot  h 

Thk  k  remarkabiy  doe*  to  the  fcasot  dfr 
mention  of  ■■regaling  parade*  Kudbd  k 
ths  m  n  randaT  mnrnlrg  rhat  the  two  pro- 
caaa  are  reload.  There  i*  now  growing sre 
dene*  that  rites  grea  ts  tight  The  mahenwt- 
ka  of  randbaa  diffusion  can  be  racaar  in  a 
form  that  jaanatogouatoekaamds— Mates  af 
a  fluid  moving  under  prtaure.  So  tneapwh 
arencal  coincide  nee  of the  fractal  dimenttone 
of  two  proceaa  ha  lad  to  a  surprising  dwe- 
racical  waaatxT.  between  them. 

in  pmcttec/oil  doe*  not  occur  in  brgt 
free  spaces  but  k  muted  frt  with  parados  of 
rock  or  and.  Dr  Feder  and  others  hare  in- 
vasdgatad  viscous  fingering  in  mixtures  of 
rode  and  sand.  They  hove  found  that  (he 
fractal  dimention  of  die  shapes  made  by  (he 
oil  m  it  mixes  with  water  ia  reduced  from  I.) 
to  about  1.62.  The  feet  chat  the  fractal  ds- 
mention  is  lower  mean*  that  lea  oil  will  be 
saureted  out  by  the  tame  amount  of  warn 
when  the  oil  is  dispersed  in  porous  rod 
stint*.  Knowing  this  should  help  companies 
to  extract  oil  more  rfiaently  by  changing 
their  pumping  methods  to  inn  the  rock 
strata  tha  occur  in  *  given  well 

An  apidtank  of  frectab 

Not  only  particles  gather  in  duste.*;  people 
do  it,  too.  Dr  Peter  Graasbeiger  at  the  Uni¬ 
versity  of  Wuppertal  in  West  Germany  ha 
used  the  mathenvatia  or  fractal  clustering  to 
undencand  the  spread  of  epidemics.  In  s 
rwx-too-mobik  population,  a  dire..*  dut 
needs  close  contact  between  people  to  pew 
t»i  spreads  rather  like  ihe  parrici.-s  ii>  *  «A  I 
mock.  The  infection  “diffiwu"  at  random 
through  die  population  and  "wfehl"  whf-t 
i-  becomes  infectious.  A  newly  mitered  vet 
acts  a  a  centre  for  further  diffusion. 

The  process  can  be  simulated  on  s  w*- 
puter  by  pretending  that  individuals  Ihe  in 
the  cells  of  a  square  array,  like  a  hugs  there 
board,  and  watching  the  infection  more 
from  one  square  to  another.  The  elects  of 
different  “tret  amission  rule*”  for  the  threat 
(such  as  that  the  infection  can  more  only 
from  one  ceD  to  ar  immediate  neighbour), 
varrevr  rata  of  infinrron  foj,  the  infection 
»dl  more  to  t  nekhhouring  ceil  oniy  sfrer 
ter,  days),  and  different  immunnsrion  proce- 

•■K  eooMOsnr  «orwo*n*»  tsre 
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Some  mathematician*  think  that  the 
Mack  snowman  shape  pictured 
above — called  the  Mandelbrot  set- 
may  be  the  moat  complex  object  In  the 
universe.  It  is  an  infinitely  detailed 
fractal  obtained  by  telling  a  computer 
to  draw  the  co-ordinates  generated  by  a 
mathematical  formula.  The  formula  is 
simple— except  for  the  fact  that  it 
involves  the  square  roots  of  negative 
numbers.  The  colours  are  added  later, 
to  taste. 

The  other  pictures  on  our  colour 
pages  are  all  close-ups  of  details  of  the 
Mandelbrot  set.  They  show  that  the 
same  whorls,  tendrils,  spirals  and 
snowmen  keep  appearing,  even  when 
magnified  millions  of  times. 
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dures  can  then  be  explored  and  tested. 

Often  the  result  is  a  fractal  distribution 
of  the  -h«e2se-  the  complicated  pattern  of  in¬ 
fected  cells"  is  the  sane  on  several  scales. 
Thus  an  infection  map  of  a  city  will  look 
much  like  the  infection  map  for  each  block, 
which  will  look  like  the  infection  map  for 
each  street  Clusters  ot  infected  cells  form, 
hrerchiny  in  a  similar  manner  to  the  OLA 
model.  It  turns  out  that  the  spatial  distribu¬ 
tion  of  an  infection — where  the  ill  people 
are  m  the  first  place— <an  be  crucial  to  the 
wav  the  disease  spreads  later. 

Thes'  ideas  have  .viaications  for  the 
stuoi  o>  e.L's.  Simple  models  take  the  aver¬ 
age  rate  of  inti. non  ior  a  disease  and  apple  it 
lo  a  uniformly  rand  nr  spread  of  rniected 
I'eop  e  Sc  I  averages  Co  not  mean  much, 
better  r,>  •dcisiecogn'se  thai  j'eoplt  differ  in 


their  behaviour  and  thus  spread  the  disease 
at  widely  varying  rates.  Average  infection 
rates  ignore  this  variation  and  so  can  lead  to 
wildly  wrong  predictions. 

Any  model  with  a  fair  chance  of  coming 
up  with  the  right  answers  has  to  recognise 
that  society  is  an  irregular  cluster  rather 
than  an  homogeneous  mass.  Most  of  the 
time  people  move  in  their  own  social  circles 
but  different  circles  can  also  interact  with 
each  other.  This  makes  life  horribly  compli¬ 
cated  for  epidemiologists.  Dr  Robert  May,  a 
mathematical  biologist  at  Princeton  Univer¬ 
sity,  is  working  on  simulations  of  the  spread 
of  aids  based  on  ideas  in  "chsotic  dynam¬ 
ics".  They  deal  with  the  sort  of  structured 
irregularities  found  in  fractal  geometry. 

If  the  notion  of  fractal  clusters  can  make 
the  enormous  )ump  from  particles  to  people. 
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-  Amor  ,  th-  *:  ’ ,  ;;,.vio- 
I'O'r .!-  •  ;  .nr-.i-:'-.  y-rrM  lo 

Jtocuci  .».<  .  ..  »  v.:-,ipri  •.  .  ;ri  .vc- 
ompurji  usually  su  .-d.i  enormous  amounts 
of  computing  power  i-  would  take  the  ran- 
bused memory or  !0  '00 home -••  -.  ■•,• 

■tore  the  data  needed  to  -econsr-  uct  the  cra¬ 
tered  su  rfaceott  he  moon  Th*  reasonable 
•not!*1--  r>  atror.i  ...a: .  ir-ugue  of  lo¬ 
ur  geography,  but  too  expensive  i‘  ill 
■ou  warn  is  a  convt:  v  Pa  nr-ound  f.t  a 
clevis  ion  science-fiction  drama.  Fractal 
forgeries  chat  mimic  the  forms  with¬ 
out  worv-ng  about  precise  derails  car 
-w  tne  |ob  on  a  relatively  modest 
computer. 

O',.!  o'  [he  »;os  pt’seerp  !  ,e.’ 
nq'w_.  m  compute:  programming  • 
■reunion,  in  which  a  proc-dure  ,• 

- oii-i  down  into  a  r.  querrt  o?  repe- 

•  ciu,  oi  iue».'  0»;i  ncrr.t  ,t  exuuv.pl: 

»  t.  .-cursive  i.-.  pe  for  'cmlr'uv  s 
call  r, e-„,  is;  -  cou-j.  of  ‘.ncU . 

•  Id  u  axxll  on  i  ij.  of  ut  This  is 
••X  ii  .,1.\  s'  *r  .-ojrvds  because  .'he 
-'iw-V—.'. ic  i  ’  h.'Uw  j  u*aii  can  be  >i  - 
uned  in  terms  f  hr  snr  instruction, 

■’u-,'  a  rot  r*  of’  fr  -.  h".  ru. :  you  lay 

a  cot.-.-,  or  htvkf.  *ri*n  "c-  lay  t 
Abet  .  rop,  a:  '  anothe  j*  c  on. 

Ml  you  have  rc  vij  u  ;  rule  idling 
when  r-  -'r- 

Uh.  a  reremiv.*  see  ins-ruv 
-•vis.  fra.  tali  break  up  i-ro  .civm  of 
ncni»e'-  i.  NariH-see-.mxg  fo*m: 
xiti  Kart  to  citi-rgf  or.  the  screen 
wher.  a  fe^  ra,/dc  tr.  number-,  a-e  f.J 
■  >o  throw  up  irrcg  liar  foatures  Sy  nereis- 
ig  the  !i  acral  din  en,ion  of  ihe  object  <c  be 
constui trd  its  s  i.-face  can  be  n-  >  rougher 
.  r.d  mc-f.  peeked,  r  •  jctals  were  used  >u  cre¬ 
ate  the  gev^aptr,  >:  .he  Moons  of Endor  m 
Mr  Go-.ge  i  ucac  >  "Th;  P.et-.rn  of  the 
'edi"  I  i  :’*.er  Optv-.f  c-r.r:  *  the  New 
Tori  Iioiuuif  oi  It-  I.noiogy  uses  the  fot- 

•  i  'as...  ..  ivtal-Kaivhing  pi  ^  esses  *«  pr> 

.  ir  Id.  like  trees  ano  plants. 

Or  jh»jr.  Lovr.ov  at  McGill  University 
::  ‘cal  has  -n  •;*!  U-xiijs  using 

■  »  a  an.,  vt.itc  u.  the  cone  UMCr: 

•  r  :f  ’  .  ce  ih*  ran--  fi.via’  Jimeasiou 
-•  ur  tn  (,-.fers  c‘  rr,ngnit':d-.--'Tom  tetis 

r  li'oustir.d-.  i,!->"ic:-os.  Such  a 
iinfomii>  i.  almost  unprece- 
ht  naicial  »mr!d.  It  means  that 
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o  t.  a  ,ta,  s.iOa,  icr  the  most  part,  the 
~.u’,e  K«  of  patterns  as  ram  charts  for  a 
month,  a  'veek,  o"  a  smglr  day.  So  the  tem¬ 
poral  stiuciurc  cf  rain  is  aNj  fractal 

The  idea  of  distributioti  across  nme — te, 
the  shape  drawn  '  n  a  tha.t  w-t  .  a  nme- 
».tis— lets  the  concept  ot  frac.als  apply  to 
sound  and,  more  generally  tc  what  physi- 
'‘n  call  “noise' .  Physicists  use  the  term 
“noise"  to  refer  to  any  process  that  fluctu- 
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nhotefraph  of  a  cloud,  wit!-,  no 
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<ra'-  there  ,.t  ic.  c'ues  m  the  shape  of  the 
cloud  itscl'  that  will  ell  you  whether  it  is 
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Xlythical  mountain,  conjured-up  clouds 


ares  irregularly  over  time,  even  if  it  does  not 
involve  y.-jnd  Different  sorts  of  noise  are 
classir-.*  -c'o-dmg  to  i’ncn  "spectral  den¬ 
sity".  This  measures  which  frequencies  oc¬ 
cur,  and  how  often  "White"  noise  has  equal 
amounts  of  all  frequencies  (just  as  white  light 
has  equal  amounts  of  au  codvcrs)  and  is  en¬ 
tirely  random  The  noise  at  any  given  time 
cannot  be  predicted  from  the  noise  at  earlier 
•imes.  "Brown  noise"  u  named  after  a  nine¬ 
teenth  century  Scottish  botanist,  Robert 
Brown,  who  sruJieo  :h<  -r  h  c.  m.'crn  of 
onv  pari  .  irs  floating  :r  a  liquid  Brown 
rjisc  is  much  more  ordered  than  white 
ioi»e.  Tli*  noise  at  a  t.me  dejiends  to 
vine  extent  . ,  wha;  i;  *■:•>  it,  die  pas:.  And 
r.  coiitamu  .noit  high  firqu*r::es  and  fewer 
low  ones  than  white  noise  intermediate 
.,pe  of  muse  is  known  as  I//  noise  because 
each  frequency,  f.  occurs  a:  a  r.’-.e  nai  is  in¬ 
versely  proportional  to  ::s  pitch  .lie  higher  a 
note  is,  :he  less  often  ir  appears.  All  three 
tvpes  of  noise  produce  wic."1',  'rac  al  curves  if 
.,  .sc.  t  ‘h  i.:  .  .....  T..<  wiggles 

nil  s  •>  ign‘..--„  r.f.d  on 

Remeri  het  that  inythir.f  -hi.h  changes 
iir.it  ...r  i  •  regained  is 
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■  •  f  cKcans,  the  historical  vana^ 
>. if  Nile.  rKc energy  oui' 
.  '  •r  insmission  of  stgrials 
;  i  i >'  u  -iii  also  be  found  in  the 

behaviou  of  electronic  components. 

Mus.i  seems  to  flow  like  1//  noise.  Dr 
I  it  .  s  si  IBM’s  research  laboratories 
oi  New  iork  state  has  analysed  variations  of 
pitch  in  many  kinds  of  music  and  found  that 
1 -c.se  predominates.  This  is  equally  true 
of  Gregorian  chants,  Beethoven’s  sympho¬ 
nies,  Debussy’s  piano  works  the  rags  of 
Scotr  joplin,  and  the  Beatles'  Sergeant  Pep¬ 
per  album.  Only  a  few  modem  composers, 
such  as  Karlheiiu  Stockhausen  and 
Elliott  Carter,  violate  this  rule.  Dr 
Voss  has  produced  fractal  forgeries  of 
music  cn  a  computer  using  white, 
i  brown  and  I//  none.  White  music  is 
J  far  too  random  and  brown  music  fat 
-  too  correlated  to  sound  like  any  sort 
of  :«xl  music.  But  artificial  1// music, 
tty:  Dr  Voss,  sounds  as  if  it  is  music 
produced  by  I  foreign  culture.  He 
notes  thar  painting,  drama  and  sculp¬ 
ture  usually  im  ’ate  nature  in  some 
way.  So  what  does  music  imitate.’  He 
suggests  it  imitates  the  !//noue  cf  tSt 
natural  world— "the  characteiutic 
way  our  world  changes  with  time" 
Fractals  ate  novel  in  so  many 
ways  that  it  is  easy  to  regard  them  as 
wholly  isolated  from  traditional  math- 
ei.vatiu.  Ti*.  would  be  a  mistake:  rhe 
theory  of  fractals  is  closely  linked  to  at 
least  one  apparently  independent 
field,  chaotic  dynamics.  Chaotic  dy¬ 
namics  is  a  belated  recognition  that 
purely  deterministic— le.  predict¬ 
able — mathematical  models  can  throw  up 
apparently  random  results.  For  example, 
imagine  an  insect  population  that  grows 
from  one  breeding  season  to  the  next  ac¬ 
cording  to  a  fixed  numerical  formula  The 
population  next  year  can,  in  theory,  be  cal¬ 
culated  from  this  year’s.  Yet  despite  such 
regular  laws  '  f  growth,  the  population  c«.'. 
fluctuate  -ildly  and  unpredictably  This  is 
because  tiny  errors  in  the  calculation  can 
blow  up  •  -  wildly  divergent  piedictions 
O'  r-  n  short  tirre  The  result,  for  ail  practical 
purposes,  is  randomness,  or  chaos 

Pran  -is  3nd  chaos  come  togethei  tn  the 
study  of  tutbulent  flow.  Scientists  have  long 
bexn  puttied  by  the  way  fluids  sometimes 
flow  smoothly  aid  at  other  ttm*s  break  up 
into  an  irregular  frothing  mass.  The  same 
body  of  fluid  can  have  both  turbulent  and 
smooth  regions,  with  a  complicated  border 
between  them.  The  classical  approach  to  tur¬ 
bulence  sees  it  as  a  cascade  in  which  the  en¬ 
ergy  of  fluid  motion  u  progressively  passe  1 
to  smaller  and  smaller  vortices.  Such  a  pro¬ 
cess  is  fractal  because  the  ever-smaller  vorti¬ 
ces  hive  the  same  structure  on  many  scales. 
The  brsves  nope  for  fractals  is  that  they  will 
unuvcl  the  mysteries  of  chaos. 
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by  Mort  La  Brecque 


In  194?,  Szolem  Mandelbrojt,  a  prnm- 
incnt  French  mathematician  whose 
specialty  was  the  abstruse  field  of 
complex  analysis,  had  some  words  of 
advice  to:  a  jilted  nephew  It's  very  nice 
tor  children  to  gel  some  feel  for  geome¬ 
try.  M,indelbro|t  counseled  the  young 
m.in,  who  was  about  to  undertake  his 
higher  mathematical  education,  but  vou 
must  leave  il  behind;  a  mature  mathe¬ 
matician  does  not  use  visual  images 
Like  many  other  youths  before  and 
since,  benuit  Mandelbrot  decided  to  rc- 
Icd  the  wisdom  of  his  elders.  He  had 
developed  a  passionate  attachment  to 
shape  and  form  that  he  could  not  relin¬ 
quish.  The  decision,  in  this  case,  has 
been  vindicated  by  time.  Not  only  has 
his  pursuit  of  a  geometrical  grail  guided 
Mandelbrot  to  extraordinary  success  as 
a  mathematician,  but  the  fractal  geo  me¬ 
re  to  which  it  led  has  profoundly  influ¬ 
enced  contemporary  science  as  well. 

I  hc  concept  with  which  Mandelbrot's 
name  h.is  t*ecoinc  synonymous  is  de¬ 
ceptively  simple:  An  ob|eet  that  is  self- 
similar  has  a  rough  shape  to  one  degree 
o'  another  made  of  parts  which,  when 
magnified .  resemble  the  whole.  The 
parts  are  divisible  into  look-alike  en¬ 
tities— and  this  geometric  cloning  con¬ 
tinues  forever,  at  least  tn  the  abstract 
world  of  pore  mathematics.  Mandelbrot 
'•'"nod  the  word  fractal  to  describe  a 
sell--imilar  ol’ioct—  the  Latin  jraclus. 
meaning  irregular  and  fragmented, 
suits  its  twisted  and  tormented  form 
(See  Fractal  Symmetry"  by  Mort  La 
Brecque.  Mosaic  Volume  16  Number  J.) 

If  Iractal  is  a  new  word,  self-similanty 
can  hardly  he  considered  a  new  idea. 
The  image  of  a  flea  upon  a  flea  that  Swift 
employed  in  On  Poetry  refers  to  the 
London  literary  scene  but  was  inspired 
by  Gottfned  Wilhelm  von  Leibniz,  the 
seventeenth-  and  eighteenth-century 
German  philosopher  and  mathemati¬ 
cian  Although  Leibniz's  exuberant  op- 
nrn.sm — all  is  for  th<  best  in  this  best  of 
all  possible  worlds-  was  wickedly  sati¬ 
rized  by  V’.il'aire  in  Cji.e.-dr  h«  -!so  had 


Fractals  Self-similar  branching  produces  images  of  organic  tree  and  inorganic  snowl  a-e 


So,  Nat'ralists  observe,  a  Flea 
Hath  smaller  Fleas  that  on  him  prey; 

And  these  have  smaller  Fleas  to  bite  'em; 
And  so  proceed  ad  infinitum. 

— Jonathan  Swift, 
Off  Poetry.  A  Rhapsody 


This  is  ixirl  one  of  n  tuv-pnrt  sprint  repirt  Iw 
Mort  Iji  Pr".fucon  Iroctnl  n/ip/rirtfnn;- 


Fractals  are  far  more  than  the  fantastic  fruits  of  the 
crossmatching  of  geometric  theory  and  computer  graphics. 
Both  the  spawn  and  the  seed  of  a  mathematical  revolution,  they 
are  influencing  an  increasing  range  of  scientific  undertakings. 


even 


Peitger..  fnert.  ,s  sq  much  complexly  in  these  systems  so  much  witoness  and  structure 


the  worthier  notion  that  in  every  d'op  of 
dew  is  an  entire  world  with  its  own 
drops  of  dew,  themselves  containing 
worlds — and  dewdrops — of  their  own 

"That  has  a  strong.  ilmost  theological 
resonance  for  man,*  says  Mandelbrot 
Fractals  have’  occotne  popular,  he  con¬ 
tends.  because  of  the  intrinsic  appeal 
they  have  for  us.  now  that  their  nature  is 
undershiod 

Science  1  as  succumbed  to  the  lure  of 
fractals  for  less  mystical  reasons.  “The 
mathematical  concepts  related  to  fractals 
have  gone  a  long  way  in  uniiving  areas 
of  physics,  chemistry,  and  biology  that 
were  previously  obscure  and  couldn't 
be  approached, "  says  chemist  Raoul 
Ki  peiman.  who  works  at  the  University 
of  Michigan. 

The  fractal  world 

Mandelbrot,  who  has  used  the  ron- 
■  ■.■pt  ol  self-similarity  since  the  late 
IV5us,  believed  initially  that  he  had  tut 
upon  a  basic  organizing  principle  of 
nature  There  was  a  very  widespread 
feeling,  fostered  by  many  poets  and 
great  writers,  that  nature  has  an  organic 
complication  which  no  mathematics  can 
ever  imitate,'  he  says  'It's  ironical  that 
fractals,  many  of  which  were  invented 
(by  nineteenth-century  mathematicians! 
as  examples  of  pathological  behavior, 

L:  Hn'njnc  hn  ,  n'r.l  i/vd  In  Mosaic  on 
nun ,* ,/  'tth/it /-  in,  •  KT.  a!  ci.i  lc  tea- 
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turn  out  not  to  be  pathological  at  all.  In 
fact  they  are  almost  the  rule  in  the  uni¬ 
verse.  Shapes  which  are  not  tractal  are 
the  exception* 

Those  exceptional  shapes  are  the  per- 
toct  lines,  planes  ...id  cubes  of  Euclid, 
which  have  been  part  of  our  culture  for 
2.000  years,  “t  love  euclidean  geome¬ 
try."  be  says,  'but  it  is  quite  clear  that  it 
does  not  give  a  reasonable  presentation 
ol  the  world.  Mountains  arc  not  cones, 
Clouds  are  not  spheres,  trees  are  not  cyl¬ 
inders.  Almost  everything  around  us  is 
essentially  noncuclidean.' 

There  is  both  an  upper  and  a  lower 
limit,  however,  to  the  size  range  over 
which  natural  fractals  arc  fractal:  At  cer¬ 
tain  points,  thev  may  either  become 
smooth  or  rough  but  not  fractal,  or  else 
they  reach  their  particular  ultimate  stale 
in  bigness  or  smallness.  Moreover,  natu¬ 
ral  fractals  aTe  fractal  in  a  statistical  or 
s’en  hastic  sense,  a  particular  shape  giv¬ 
ing  no  clue  to  the  length  scale  at  which  it 
was  determined  and  not  looking  exactly 
like  a  shape  on  a  different  length  scale. 
Exactitudes  and  infinities  exist  only  in 
the  province  of  mathematical  fractals. 

The  range  ol  natural  phenomena 
encompassed  bv  self-similarity  is 
•.stone  lung  In  addition  to  the  moun¬ 
tains,  clouds,  and  trees  mentioned  by 
Mandelbrot  and  the  galactic  clusters  and 
H-i-bulcnt  flows  on  which  so  much  ol  his 
w,  irk  c-nune<!,  there  are  proteins,  acid 
»am  n-posttu'-"  the  surface  of  the 
i..  :b.  eh  /  .n.  >,  earthquake  patterns, 
.a  ~,t  .  .  ■cch.an.ral  a'-fl  elcc- 


n .. v, i  sv'.mi'is,  chemical  rcactim  •• 
the  path  rn  in  which  oil  and  ...ib  r  do 
nil  mix.  I  racial  materials  also  include 
amorphous  materials  like  glass,  col¬ 
loidal  aggregate's,  eleclrodcpo-uh  b  met¬ 
als,  electrolytes,  thin  hints,  eoal.  and  ce¬ 
ramics  Even  the  cracks  m  ceramics  are 
actually  fractals. 

An  equally  impressive  list  can  be 
culled  I  mm  the  world  of  mathematics, 
from  whence  the  shape  of  Iraelnls 
sprang.  To  the  Cantor  bar,  IVa  no  curve , 
and  Sierpinski  gasket  of  the  late  nine¬ 
teenth  and  early  twentieth  centuries— 
now  often  used  by  physical  and  life  sci¬ 
entists  as  models  ol  natural  fractals — 
has  Iven  added  the  Mandelbrot  set  ol 
the  I, ile  Iwentietli  century,  This  bizarre 
object,  simultaneously  well-ordered  and 
wildly  chaotic,  is  the  locus  of  intensive 
scrutiny  bv  some  of  the  best  mathe¬ 
matical  minds. 

Mandelbrot 

All  the  activity  in  science  and  mathe¬ 
matics  that  has  identified  and  explicated 
those  fractals  can  be  traced  from  a  bur¬ 
geoning  number  of  younger  acolvtes  to 
the  central  avuncular  figure  of  Benoit 
Mandelbrot.  He  is  to  fractal  geometry 
what  Einstein  was  to  relativity  and 
Trend  to  psychoanalysis.  Although  he 
has  often  ruffled  the  feathers  of  some 
colleagues  bv  his  immodest  insistence 
that  credit  go  where  credit  is  due,  most 
would  probably  agree  that  his  peripa¬ 
tetic  imagination,  proselytizing  fervor, 
and  sheer  dogged  persistence  virtually 
created  the  field. 

Mandelbrot,  now  at  Harvard  Univer¬ 
sity.  conducted  most  of  his  work  over  a 
period  of  nearly  30  years  at  IBM's 
Thomas  ].  Watson  Research  Center, 
where  he  continues  as  an  IBM  follow 
Oddlv  enough,  his  interest  in  Iractals 
began  about  that  time,  when  he  was 
studying  short-  and  long-term  com¬ 
modity  price  changes.  The  structure  of 
the  fluctuations,  he  discovered,  could 
be  reproduced  by  a  self-similar  forgery. 
(Were  he  to  focus  on  one  field  today,  he 
savs,  it  would  be  economics. ) 

There  followed  work  on  a  sequence  of 
problems  that  was  distinguished,  out¬ 
side  of  the  fractal  connection,  by  .ual 
absence  of  relatedness:  errors  in  Ihe 
transmission  of  data  over  telephone 
channels,  Ihe  widespread  phenomenon 
called  1/f  noise,  and  fluctuations  in  Ihe 
level  of  the  Nile  River.  Concurrently, 
Mandelbrot  was  developing  his  knowl¬ 
edge  of  maihenv  tics  and  cm  iting  new 


structures  that  he  would  then  apply  to 
the  scientific  problems  that  had  con¬ 
founded  him.  The  oscillation  between 
different  fields  of  science  and  mathe¬ 
matics  has  been  constant,  a  hallmark  of 
his  entire  career. 

Beginning  in  1964,  Mandelbrot  began 
to  consolidate  his  findings  from  his  ear¬ 
lier  disparate  studies,  at  the  same  time 
adding  to  their  number.  He  also  recalls 
the  ensuing  decade  as  one  in  which  he 
met  great  resistance  from  the  scientific 
establishment.  'I  was  certainly  the  only 
person  doing  these  things,”  he  says, 
"except  for  friends  who  occasionally 
joined  me  because  thev  were  interested 
in  a  particular  project." 

The  turning  point  apparently  came  in 
1975,  with  the  publication  of  his  first 
book  in  french,  translated  into  English 
in  1977  as  Fractals:  Form.  Chance,  mill  Di¬ 
mension.  In  the  late  1970s  and  early 
1980s,  his  work  was  finally  adopted  by 
the  physics  community,  first  by  phys¬ 
icists  newlv  engaged  in  studies  of  the 
chaotic  behavior  born  of  turbulence  and 
then  by  statistical  physicists,  a  larger 
group  interested  in  a  broader  range  of 
phenomena.  Those  influential  converts 
and  the  publication  of  Mandelbrot’s 
best- selling  second  book.  The  Fractal  Cc- 
i ime! rtf  o/  Nature,  in  1982,  brought  chem¬ 
ists,  biologists,  computer  scientists, 
geophysicists,  astrophysicists,  materials 
scientists,  meteorologists,  mechanical 
engineers,  and  scientists  from  other  dis¬ 
ciplines  into  the  fractal  (old. 

'  I  he  number  of  people  involved  is 
becoming  enormous,"  savs  Mandelbrot. 

I  don’t  know  all  of  them,  and  I  can’t 
read  everything  thev  write"  Although 


Davaney.  Aoplication  of  Julia  sets  must  wait. 


he  organized  the  first  scientific  meetings 
on  fractals  by  himself-— he  was  the  only 
person  knowledgeable  enough  to  do 
so — such  arrangements  must  now  be 
left  largely  to  others. 

Computer  graphics 

Mandelbrot  likes  to  point  out  that  his 
own  labor  was  enhanced  immeasurably 
bv  a  stroke  of  good  luck — the  simul¬ 
taneous  development  of  computer 
graphics  lhat  was  to  prove  invaluable  in 
the  application  ot  fsactals  to  science. 
'My  first  .voiK  had  no  pictures  whnt- 
soever.  and  I  found  I  couldn't  make  my 
ideas  under  tood  by  my  audience,"  he 
says  'The;  thought  I  was  making  a  fine 


technical  distinction  that  didn't  truly 
matter  to  the  central  issues  of  their 
fields,”  he  explains. 

In  the  late  1960s,  he  realized  that  he 
could  use  a  simple  pen  writer  to  draw 
real  records  of  river-level  fluctuations 
side  by  side  with  fractal  forgeries.  The 
illustrations  convinced  a  hydrologist 
that  Mandelbrot  was  making  a  point  of 
fundamental  significance.  Shortly  after¬ 
wards,  Mandelbrot  acquired  access  to 
some  of  the  first  computers  for  making 
graphics  and,  using  them  to  construct 
fractal  forgeries  of  mountains,  fooled 
people  who  saw  photographs  and  a  mo¬ 
tion  picture  of  the  images  into  thinking 
that  they  were  the  real  thing.  Since 
then,  he  has  upgraded  both  his  graphics 
and  photographic  equipment  to  pro¬ 
duce,  with  IBM  colleague  Richard  Voss, 
even  more  natural,  counterfeit  moun¬ 
tainous  terrains. 

Computer  graphics  proved  to  be 
more  than  a  rhetoric  Mandelbrot  could 
use  to  explain  his  thoughts  to  others. 
The  pictures  acquired  a  life  of  their  own, 
stimulating  him  to  make  new  conjec¬ 
tures  and  to  advance  his  own  research. 

"For  me,  the  most  important  instru¬ 
ment  of  thought  is  the  eye,"  he  says.  ”lt 
sees  similarities  even  before  a  formula 
has  been  created  to  identify  them." 
The  use  of  computer  graphics  as  an 
intuition-builder  has  persuaded  Benoit 
Mandelbrot  and  others  that  technology 
can  be  as  great  an  influence  on  science 
as  science  is  on  technology. 

Image  synthesis 

The  application  of  computer  graphics 
is  vast,  and  in  the  realm  of  image  syn¬ 
thesis  also  beginning  to  have  an  influ¬ 
ence  on  art,  both  representational  and 
abstract,  displayed  in  forms  both  tradi¬ 
tional  and  technological.  Some  of  the 
most  striking  computer-generated  pic¬ 
tures  there  are  have  been  made  with 
fractal  algorithms. 

The  first  images  made  with  a  com¬ 
puter,  created  by  Ivan  Sutherland  at  mu 
in  the  late  1950s,  were  composed  first  of 
dots  and  then  of  lines.  By  the  late  1960s, 
researchers  at  the  University  of  Utah 
had  depicted  objects  made  of  triangles 
and  polygons.  The  French  mathemati¬ 
cian  Pierre  Bezier,  one  of  the  founders 
of  computer-aided  design,  sculpted 
curved  surfaces  in  the  early  1970s,  but 
those  reference  shapes  were  merely 
drawings,  highly  inaccurate  lor  the 
needs  of  the  airplane  and  automobile  in¬ 
dustries,  where  they  were  being  used. 
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Enzyme  Iractals  Display  tiasee  on  >-:n  cryslalloqu-u'l'v  sVws  curiace  structures  ol  Iwo  molecules  ol  Itic  enzyme  superoxide  dismutase 


An  improved  r-ictbd  fur  making 
curved  surface  bv  splitting  them  into 
polygons  was  thereafter  perfected  by 
Loren  Carpenter,  then  of  Boeing  Com¬ 
puter  Services. 

Although  this  explicit  method  has  be¬ 
come  the  standard  for  making  curved 
surfaces,  it  leaves  a  lot  to  be  desired. 
The  entire  image  must  be  done  by  hand, 
that  is  with  direct  mental  intervention  of 
the  human  model-builder,  who  must 
specify— explicitly — the  coordinates  oi 
every  corner  or  control  point  that  lies  in 
a  curve  Since  any  complex  shape,  such 
a?  a  tree  or  a  hill,  could  require  hun¬ 
dred.-.  of  thousands  or  even  a  million 
points  to  l»e  described  adequately,  the 
cost  in  human  labor  is  prohibitive,  ev 
cepl  for  she  ;iudist  approximati  i.s 

In  ]97i-.,  Carpt  i.ici.  r caning  a  review 
ot  Mandiibii'1';  first  book  saw  imme¬ 
diately  that  iractals  offered  a  way  of 
overcoming  those  limitations  and  began 
to  develop  -n  algorithm  to  do  so.  T  hat 
idea  occurred  at  the  same  time,  inde 
pendeotlv,  to  Alain  Fournier  and  Don 
Fussell  of  the  University  of  Texas  at  Aus¬ 
tin.  and  eventually  the  three  published 
a  paper  together  in  a  journal  of  the  As¬ 
sociation  for  Computing  Machinery 

Computers  take  over  from  tbt 
human — for  the  most  part — in  their 
stochastic  modeling  techniques  "You 
lef  the  computer  generate  r.-odorn 
shapes  in.ii  are  runs1  ... pod  by  certain 
rules,"  f  -  peril  -  ’.plain.  a  .d  if  you 
use  rules  It  a!.  -  e  >  .1  a!.- t-Kh  d  from 


ps. verses  the!  yield  natural  forms,  you 
car.  •va.ntc  their  appearance.’ 

To  produce  a  simple  fractal  curve  that 
might  bo  used  to  form  a  fractal  moun- 
ta.n,  tor  example  tK  computer  pro- 
giam  vertical!’/  breaks  a  line  somewhere 
octv  v'  n  the  two  end  points  That  dis¬ 
tance  is  constrained  by  three  rules  de¬ 
termined  hv  the  programmer.  It  must  he 
proportional  to  the  length  of  the  dis¬ 
tance  between  the  end  points  so  that  the 
same  approximate  shape  is  produced  at 
all  length  scales;  it  must  have  a  global 


scale  factor  that  specifies  the  degree  of 
roughness  desired  in  the  curve;  it  must 
have  a  certain  distribution  of  random¬ 
ness,  usually  that  of  a  Gaussian  curve 
on  which  most  of  the  points  are  clus¬ 
tered  near  the  center 

Once  the  line  is  broken,  the  two  re¬ 
sulting  lines  are  severed  again  according 
to  the  same  principles,  as  are  the  four 
lines  that  result  from  the  second  opera¬ 
tion.  This  recursive  splitting  is  repeated 
until  a  crinkly  curve  is  produced  of  such 
statistical  complexity  that  a  human  be¬ 
ing  could  never  reproduce  it  without  a 
computer.  More  important,  the  moun¬ 
tain  assembled  from  such  curves  will 
look  like  a  real  mountain. 

Filmed  fractals 

Carpenter  created  a  two-minute-long 
animated  film  to  illustrate  his  ideas. 
Shown  at  the  1980  ACM  siGCRAm— Spe¬ 
cial  Interest  Croup  in  Graphics — con¬ 
ference  “Vol  Libre"  portrayed  a  simu¬ 
lated  flight  over  a  fractal  landscape, 
which  included  a  number  of  different 
fractal  processes.  It  also  demonstrated 
that  computer-animated  film  could  be 
entertaining  as  well  as  instructive. 

The  movie  apparently  succeeded  be¬ 
yond  Carpenter's  wildest  dreams.  Tal¬ 
ent  scouts  from  George  Lucas’s  Lu- 
casfilms,  who  attended  the  conference, 
were  sufficiently  impressed  to  hire 
Carpenter  for  Pixar,  the  company's 
fledgling  computer  graphics  division. 
(Its  original  mandate  to  computerize  im- 
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Classical  Chaos 


Roderick  V.  Jensen 


A  wide  variety  of  natural  phenomena  exhibit  complicat¬ 
ed,  unpredictable,  and  seemingly  random  behavior. 
Common  examples  indude  the  turbulent  flow  of  a 
mountain  stream,  the  changing  weather,  and  the  swirl¬ 
ing  patterns  of  cream,  slowly  stirred,  in  a  cup  of  coffee. 
The  paradigm  for  this  dass  of  macroscopic  phenomena  is 
the  problem  of  turbulent  flow  in  fluids  (Fig.  1).  Addition¬ 
al  examples  of  complex,  irregular  behavior  occur  'in  the 

dynamics  of  molecules  and  atoms  in  _ 

a  gas  or  charged  particles  in  a  plas¬ 
ma.  These  microscopic  systems  de-  NeW  W 

fine  another  class  of  important  physi-  ,  .  , 

cal  problems  which  raise  a  disturbing  Studying  Cr 

question:  How  can  the  deterministic  make  the  1 
and  reversible  motions  of  individual  . 


particles  give  rise  to  the  irreversible 
behavior  of  the  system,  as  described 


also  raisi 

by  statistical  mechanics  and  thermo¬ 
dynamics?  fundamen 

Although  physics  has  made  _ 

monumental  strides  in  the  last  hun¬ 
dred  years,  theoretical  descriptions  of  these  complex 

Ehenomena  have  remained  outstanding  unsolved  prob- 
ms.  The  difficulty  lies  m  the  nonlinear  character  of  the 
mathematical  equations  which  model  the  physical  sys¬ 
tems:  the  Navier-Stokes  equations  for  fluid  flows  and 
Newton's  equations  for  three  or  more  interacting  parti¬ 
cles.  Since  these  equations  do  not  generally  admit 
closed-form  analytical  solutions,  it  has  proved  extremely 
difficult  to  construct  useful  theories  that  would  predict, 
for  example,  the  drag  on  the  wing  of  an  airplane  or  the 
range  of  validity  of  statistical  mechanics.  However,  in 
the  last  ten  years  considerable  progress  has  been  made, 
using  a  unique  synthesis  of  numerical  simulation  and 
analytical  approximation. 

The  key  to  the  recent  progress  has  been  the  use  of 
high-speed  digital  computers.  In  particular,  high-resolu- 
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New  methods  for 
studying  chaotic  behavior 
make  the  unpredictable 
more  understandable  but 
also  raise  disturbing 
fundamental  questions 


tion  computer  graphics  have  enabled  die  "experimental" 
mathematician  to  identify  and  explore  ordered  patterns 
which  would  otherwise  be  buried  in  reams  of  computer 
output.  In  many  cases  the  persistence  of  order  in  irregu¬ 
lar  behavior  was  totally  unexpected;  the  discovery  of 
these  regularities  has  led  to  the  development  of  new 
analytical  methods  and  approximations  which  have  im¬ 
proved  our  understanding  of  complex  nonlinear  phe¬ 
nomena. 

yjyg  novel  approach,  which 
\ods  for  combines  numerical  "experiments" 

.  sj,  .  with  mathematical  analysis,  has  giv- 
tic  behavior  en  rise  to  a  new  interdisciplinary  field 
nrt>dirtah1/>  called  nonlinear  dynamics.  The  work 
done  in  this  field  has  been  applied 
indable  but  not  only  to  problems  in  physics  but 
icturhincr  also  to  a  wide  variety  rtf  nonlinear 

IblUTVmg  problems  in  other  scientific  fields, 

questions  such  as  the  evolution  of  chemical 

_  reactions  (7),  the  feedback  control  of 

electrical  circuits  (7),  the  interaction 
of  biological  populations  (2),  the  response  of  cardiac  cells 
to  electrical  impulses  (3),  the  rise  and  fall  of  economic 
prices  (4),  and  the  buildup  of  armaments  in  competing 
nations  (5).  In  this  article  I  will  limit  myself  primarily  to 
physical  problems.  However,  I  hope  that  readers  will 
recognize  the  applicability  of  these  methods  to  their 
varied  fields,  since  the  difficulties  in  solving  nonlinear 
equations  are  common  to  every  branch  of  science. 

Nonlinear  dynamidsts  use  the  word  "chaos"  as  a 
technical  term  with  a  precise  mathematical  meaning  to 
refer  to  the  irregular,  unpredictable  behavior  of  deter¬ 
ministic,  nonlinear  systems  (6).  Contrary  to  what  Isaac 
Newton  may  have  believed,  the  deterministic  equations 
of  classical  mechanics  do  not  imply  a  regular,  ordered 
universe.  Although  most  modem  physicists  and  gam¬ 
blers  would  concede  that  dynamical  systems  with  large 
numbers  of  degrees  of  freedom,  such  as  the  atmosphere 
or  a  roulette  wheel,  can  exhibit  random  behavior  for  all 
practical  purposes,  the  real  surprise  is  that  deterministic 
systems  with  only  one  or  two  degrees  of  freedom  can  be 
just  as  chaotic. 

Traditionally,  the  fundamental  problems  associated 
with  the  origins  of  chaos  in  turbulent  flows,  the  micro¬ 
scopic  foundations  of  statistical  mechanics,  and  the 
appearance  of  random  behavior  in  a  variety  of  other 
fields  have  been  avoided  bv  using  the  argument  that  so 
many  particles  and  degrees  of  freedom  are  involved  that 
i!  would  not  be  humanly  possible  to  describe  these 
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Figure  1.  When  motion  become*  chaotic,  the  results  are  unpredictable  and  SMsetimea  disastrous.  In  classical  dynamics,  the  behavior  of 
turbulent  fluids  has  proved  extremely  difficult  to  predict — as  we  know,  for  example,  from  weather  forecasting.  But  new  insights  about  the 
nature  of  chaos  have  revealed  an  underlying  structure  that  is  common  hi  many  natural  systems  and  even  in  human  social  behavior.  These 
insights  have  been  applied  to  such  problems  as  the  evolution  of  chemical  reactions,  the  control  of  electrical  circuits,  the  growth  of  biological 
populations,  the  response  of  cardiac  cells  to  electrical  impulses,  the  rise  and  fall  of  economic  prices,  and  the  buildup  of  armaments. 
(Photograph  r  Four  By  Five.) 


phenomena  from  first  principles.  However,  the  discov¬ 
ery  of  much  simpler  systems  which  can  nevertheless 
exhibit  behavior  as  complicated  as  these  standard  exam¬ 
ples  means  that  we  no  longer  have  to  throw  up  our 
bands  in  despair.  Using  the  computer  as  a  laboratory 
apparatus  to  study  these  simple  systems,  we  can  begin 
to  explore  and  understand  chaotic,  irregular,  and  unpre¬ 
dictable  phenomena  in  nature. 

In  this  review  I  will  concentrate  on  phenomena 
which  are  well  described  by  classical  physics  and,  conse¬ 
quently,  on  problems  of  "classical  chaos."  Unfortunate¬ 
ly,  the  question  of  chaos  in  quantum  physics  remains 
controversial.  At  present,  "quantum  chaos"  is  a  poorly 
characterized  disease  for  which  we  have  only  identified 
some  of  the  possible  symptoms.  Both  an  unambiguous 
definition  as  well  as  the  very  existence  of  quantum 
chaos  remair  upen  problems.  In  contrast,  we  have  a 
dear  understanding  of  the  symptoms  and  causes  of 
classical  chaos,  if  only  a  partial  understanding  of  the 
cure. 

I  will  start  by  examining  in  detail  two  deceptively 
simple  nonlinear  dynamical  systems  wh'ch  exhibit  a 
transition  from  regular,  ordered  behavior  to  chaos 


These  examples  will  graphically  illustrate  the  irregular, 
unpredictable,  but  nevertheless  deterministic  behavior 
we  call  chaos.  Then,  after  formulating  a  precise  defini¬ 
tion  of  classical  chaos,  I  will  attempt  to  dispel  the 
longstanding  psychological  prejudice  which  insists  on  a 
distinction  between  deterministic  and  randem  behavior 
by  showing  that  the  chaotic  beliavior  of  deterministic 
dynamical  systems  can  be  indistinguishable  hom  a  ran¬ 
dom,  process. 

This  deeper  understanding  of  chaos  will  lead,  final¬ 
ly,  to  a  slightly  more  philosophical  discussion  of  where 
classical  chaos  really  comes  from  and  what  it  is  good  for. 
We  will  see  that  investigations  of  nonlinear  dynamical 
systems  have  suggested  partial  answers  to  some  of  the 
fundamental  problems  at  turbulence  and  statistical  me¬ 
chanics  which  were  first  formulated  in  the  nineteenth 
century.  However,  this  research  has  also  raised  new 
questions,  more  profound  than  those  they  have  an¬ 
swered,  relating  to  twentieth-century  problems  arising 
from  GAdel's  incompleteness  theorem,  the  theories  of 
algorithmic  and  computational  complexity  of  moderr 
computer  science,  ana  die  principles  of  quantum  m< 
chanics  (7). 
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Figure  2.  Many  dyr.vrtr.iivt  systesn*  an  c* 

approximated  by  the  logistic  map  (equator, 
1),  which  then  predicts,  lor  example,  the  sir: 
of  a  changing  biological  population,  the 
fluctuation  of  economic  prices,  or  the 
dynamics  o i  a  periodically  kicked  and 
damped  nonlinear  oscillator.  Equation  I 
defines  an  inverted  parabola,  plotted  hoc 
for  four  different  valuta  of  a.  Once  an  imtiai 
value,  is  specified,  the  evolution  of  the 
system  is  folly  determined.  0-se  can  find  the 
values  of  x  at  succeeding  time-steps  by 
tracing  the  colored  lines  on  the  appropriate 
graph:  hom  x,  vertically  tc  f*e  oartbeia  fer 
*i.  then  horisontally  to  the  45*  line  and 
vertically  back  to  the  parabola  for  ij,  tad  so 
on  far  succeeding  values  of  I.*,.  When  a  is 
leas  than  1,  as  in  the  graph  at  the  upper  left, 
all  initial  conditions  converge  to  0  (the 
population  becomes  extinct,  the  price  falls  Co 
urn,  ctc.l.  When  a  is  increased  to  .*  rahae 
between  1  and  3,  as  in  tha  upper  right, 
almost  all  initial  conditions  are  attracted  to  a 
fixed  paint.  When  a  is  larger  than  3, 
however,  the  fixed  point  becomes  unstable; 
vs  «  3.2  there  arc  two  fixed  points 
between  which  the  value  for  x  eventually 
oscillates.  As  a  continues  to  increase,  ther¬ 
ein  be  more  and  more  fixed  points,  and  'or 
many  values  of  a,  aa  when  a  --  4,  tne  values 
for  x  wander  over  entire  intervals  in  an 
apparently  random  fashion. 


Examples  of  chaotic  dynamical 
systems:  The  logistic  map 

Perhaps  the  simplest  example  of  a  nonlinear  dynamical 
system  is  the  celebrated  logistic  nvp  This  system  is 
described  by  a  single  difference  equation 

x„  ,  =  -  x„)  (1) 

which  determines  the  future  value  oi  the  variable  i  at 
time-step  n  +  1  from  the  past  value  at  time-step  n.  The 
time-evolution  of  x„  generated  by  this  single  algebraic 
equation  exhibits  an  extraordinary  transformation  from 
order  to  chaos  as  the  parameter  a,  which  measures  the 
strength  of  the  nonlinearity,  is  in- Teased 

Although  nonlinear  difference  equations  of  this  type 
nave  been  studied  extensively  e.s  simple  models  for 
’’irboionce  in  fluids,  they  also  a  use  naturally  in  the  study 
of  the  evolution  of  biological  populations.  In  fact,  the 
review  article  on  the  logistic  map  bv  the  biologist  Robert 
May  (2)  is  a  historical  milestone  in  the  modem  develop¬ 
ment  of  nonlinear  dynamics.  Therefore,  lor  illustrative 
purposes  we  will  examine  the  use  of  the  logistic  map  as  a 
crude  model  for  the  annual  evolution  nf  a  single  biologi¬ 
cal  population.  x„  say  that  of  gypsy  moths  in  the 
northeastern  United  States,  which  exhibits  wild  and 
unpredictable  fluctuations  from  year  to  year  However, 
we  could  equally  well  consider  the  evolution  of  econom¬ 
ic  prices  determined  by  a  nonlinear  "cobweb"  model 
with  nonmonotonic,  backward-bending  supply  and  de¬ 
mand  curves  (4}  >r  the  dynamics  of  a  periodic  r’iv  kicked 
and  damped  nonlinear  oscillator. 

Writing  equation  1  in  a  s'aghtly  different  term, 
».  ,  -  iu„  .«x„  ,  wt-  mv  iiidt  it  l>  a  simple  quadratic 


equation,  with  the  first  tenn  linear  and  the  second  term 
nonlinear.  When  the  original  population  x0  is  small 
(much  less  than  1  on  a  normalized  scale,  where  1  might 
stand  for  any  number,  such  as  1  million  individuals),  the 
nonlinear  term  can  initially  be  neglected.  Then  the 
population  at  time-step  (year)  n  =  1  will  be  approximate¬ 
ly  equal  toox0.  lfa  >  1,  the  population  increases.  Ifn  <  1, 
the  population  decreases.  Therefore,  the  linear  term  in 
equation  1  can  be  interpreted  as  a  linear  growth  or  death 
rate  which  by  itself  would  lead  to  exponential  population 
growth  or  decay.  If  a>  1,  the  population  will  eventually 
grow  to  a  value  large  enough  for  the  nonlinear  term, 
-  ax„‘,  to  become  important.  Since  this  term  is  negative, 
it  represents  a  nonlinear  death  rate  which  dominates 
when  the  population  becomes  too  large.  Biologically, 
this  nonlinear  death  rate  could  be  due  to  the  depletion  of 
food  supplies  or  die  outbreak  of  diseases  in  an  over¬ 
crowded  environment. 

As  emphasized  in  May's  review  article,  the  dynam¬ 
ics  of  this  map  and  the  dependence  on  the  parameter  a, 
which  measures  the  rate  of  linear  growth  and  the  size  of 
the  nonlinear  term,  are  best  understood  using  a  graphic 
analysis  Consider  the  graphs  of  x„+,  versus  x„  (called 
"return  maps")  displayed  in  Figure  2  for  four  different 
values  of  a.  Equation  1  defines  an  inverted  parabola  with 
intercepts  at  x*  =  0  and  1  and  a  maximum  value  of 
x„.  (  =  fl/4  at  x„  =  0.5.  Using  these  return  maps,  we  can 
get  a  qualitative  understanding  of  the  dynamics  of  the 
logistic  map  without  performing  any  calculations.  The 
successive  values  cf  the  populations  can  be  determined 
simply  by  tracing  lines  on  these  graphs.  Just  start  your 
pencil  at  an  initial  x0  and  move  vertically  to  the  parabola 
to  get  *i  At  this  point  you  could  return  to  the  horizontal 
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axis  to  repeat  this  procedure  using  the  i  aJue  of  x ,  to  get 

but  it  is  more  convenient  simply  to  trace  horizontally 
to  the  45°  line  and  then  vertically  to  the  parabola  again/ 
as  shown  by  the  colored  lines  in  each  graph. 

This  graphic  analysis  tells  us  that  if  the  normalized 
population  starts  out  larger  than  1,  then  it  immediately 
goes  negative,  becoming  extinct  in  one  time-step.  More¬ 
over,  if  a  >  4,  the  peak  of  the  parabola  will  exceed  1, 
which  makes  it  possible  lor  initial  populations  near  0.5  to 
become  extinct  in  two  time-steps.  Therefore,  we  will 
restrict  our  analysis  to  values  of  a  between  0  and  4  and  to 
v  alues  of  ty  between  0  and  1 

For  values  of  a  <  1,  the  population  always  decreases 
to  0,  as  shown  for  a  —  0.95  in  Figure  2.  The  intersection 
of  the  parabola  with  the  45°  line  at  x„  =  0  represents  a 
stable  fixed  point  on  the  map.  Because  a  is  small, 
perturbation  theory  can  be  used  to  \  erify  that  almost  all 
initial  populations  are  attracted  to  this  fixed  point  and 
become  extinct.  However,  for  a  >  1  this  fixed  point 
becomes  unstable.  (This  is  readily  verified  by  tracing  the 
dynamics  in  the  second  graph  or  by  applying  a  local 
perturbation  theory  for  small  populations.)  Instead,  the 
parabola  now  intersects  the  45”  line  at  x  ~  (a  —  1  )!a, 
which  corresponds  to  a  new  fixed  point.  Conventional 
perturbation  theory  gives  no  hint  f  the  existence  of  this 
nonvanishing  steady  state  population. 

For  values  of  a  between  1  and  3  almost  all  initial 
populations  evolve  to  this  equilibrium  population.  Then, 
as  a  is  increased  between  3  and  -i.  dynamics  char."" 
.n  remarkable  wavs  Hot,  the  fixed  point  becomes 
unstable  and  the  population  evolves  to  a  dvuamic  steady 
state  in  wmch  it  altem.Ve'  »'•  ecn  a  large  and  a  small 
population.  A  timo-soqticvov  converging  to  such  a  peri¬ 
od-2  cvcle  is  displayed  in  Figure  2  for  a  =  3.2:  the 
population  eventually  cycles  between  two  points  on  the 
parabola,  x„  -  0.5  and  xr  P  .9  ,n  alternate  years.  For 
somewhat  larger  values  c;  ■;  this  pornd-2  cvcle  becomes 
unstable  and  is  rcplaci  <f  ]  '■  ,i  i-syj  ,\  ^  ,  |.  jp  wliich  ’.he 
population  alternates  high-low,  returning  to  its  original 
value  every  four  time-steps.  As  a  is  increased,  the  long¬ 
time  motion  converges  to  period-8,  -16,  -32,  -64,... 
cycles,  finally  accumulating  to  a  cycle  of  infinte  period 
Hr  a  ^ 3,52, 

This  sequence  of  "period-doubling  bifurcations"  in 
the  long-time,  steady  state  behavior  of  the  logistic  map  is 
dearly  displayed  in  Figure  3.  The  graph  shows  the 
steady  state  values  of  the  population  a  function  of  a 
ret  ween  3.5  and  4.  l;nr  a  c  3  only  a  single  steady  state 
value  of  x  -  (a  -  1 ) /  <  would  oe  displayed.  For  a  >  3,  we 
get  two  steady  state  values  then  four,  then  eight  and  so 
on.  bach  bifurcation  in  Figure  3  thu«  represents  a 
doubling  of  the  number  of  steady  state  valuer  and  a 
doubling  of  the  time  steps  in  a  period 

The  range  of  a  over  which  a  single  cycle  is  stable 
decreases  rapidly  as  die  penod  of  the  cycle  increases, 
which  accounts  for  the-  rapid  accumulation  of  cycles  with 
larger  and  larger  periods,  in  fact,  having  observed  this 
period-doubling  sequence  m  numerical  experiments, 
reigenbaum  was  abw  to  prove,  using  a  remarkable 
application  of  the  renormalization  group,  that  the  inter¬ 
vals  over  which  a  cycle  is  st  >l>ie  dec.  ewe  a  geometric 
rate  of  ~  4.6692ill*>  Ti  .  vmendous  signif...*'  .c**  of  this 
work  is  that  th  ■.  rate  ,iru!  oils.  proport.es  of  the  pcriol 
douHit'.c  •  .’i  >  *  r,  iu  i>‘  V  vi'  universe!  in  th"  -e- . 


that  they  appear  m  the  dynamics  of  am  system  w.v  ;b 
can  be  approximately  modeled  by  a  nonlinear  map  with 
a  quadratic  extremum  (3).  Feigenbaum's  theory  has 
subsequently  been  confirmed  in  a  wide  variety  of  physi¬ 
cal  systems  such  as  turbulent  fluids,  oscillating  chetrical 
reactions,  nonlinear  electrical  circuits,  and  ring  lasers  i  i  >. 

The  investigation  of  period  doubling  in  nonlinear 
dynamical  systems  provides  a  superb  example  of  the 
interplay  between  numerical  "experiments"  and  analvti- 
cal  theory.  However,  this  sequence  of  regular  periodic 
orbits  is  only  the  precursor  to  chaos.  Since  the  period¬ 
doubling  route  to  chaos  has  been  the  subject  of  several 
other  review  articles  and  texts  (2, 3-10),  I  will  now  move 
on  to  still  larger  values  of  a,  where  the  dynamics  of  the 
logistic  map  are  truly  chaotic. 

For  many,  if  not  most,  values  of  a  >  3.57...  the 
bifurcation  diagram  shows  that  the  long-time  behavior  of 
the  population  is  aperiodic  and  ranges  over  continuous 
intervals  of  x.  As  I  will  demonstrate,  the  evolution  of 
populations  in  these  continuous  intervals  is  indistin¬ 
guishable  fmm  a  random  process,  even  though  the 


Contrary  to  what  Isaac  Neuron  may 
have  believed ,  the  deterministic  equations 
of  classical  mechanics  do  not  imply  a 
regular ,  ordered  universe. 


logistic  map  w  fully  deterministic  in  the  sense  that  there 
are  no  "random"  forces  and  the  future  is  completely 
determined  by  the  initial  condition,  x0. 

However,  we  also  find  window?  of  periodic  behav¬ 
ior  embedded  in  this  chaotic  regime  The  most  promi¬ 
nent  window  corresponds  to  a  period-3  cycle  for  a  ~ 
3.83,  in  which  the  population  increases  in  two  successive 
years  and  decrease*,  in  the  third.  Moreover,  as  a  is 
increased  within  this  window  o*  stability  the  period-3 
cycle  can  also  be  seen  to  exhibit  period-doubling  bifurca¬ 
tions  to  penod  6  -12.  -24,  ...  cycles.  In  fact,  between  a,^ 
and  a  —  3.  S3  there  are  windows  of  stability  for  every 
integer  penod,  which  terminate  in  a  period-doubling 
cascade  back  re  chaos.  Although  the  windows  of  stability 
for  most  of  th.*  higher-order  cycles  are  too  narrow  to  be 
seen  in  Figure  o,  a  period-5  and  a  period-6  cvcle  can  be 
readily  discerned 

It  is  \  rema-kabte  mathematical  fact  that,  although 
these  intervals  o  stability  are  dense  throughout  the 
range  ot  a,  it  is  not  correct  to  conclude  that  the  set  of 
values  of  a  for  which  the  notion  is  truly  chaotic  is 
negligibly  small.  On  the  contrary,  this  set  has  been 
proved  to  have  a  non  vanishing  measure  (II).  In  other 
words,  if  the  exact  evolution  of  x„  looks  chaotic,  then  it 
probably  is;  we  are  not  necessarily  being  deceived  by  a 
very  long,  but  periodic  ryde.  In  particular,  the  irregular 
dyr  ’mins  for  a  «  H  which  deterministically  spans  tire 
entire  unit  ;nt"rval.  is  easily  shown  to  meet  the  defini¬ 
tions  of  re-oh  i  chaotic  end  a  random  process  formulated 
later  in  tori  -  tie’e. 

■'•nr. iti.--  striking  feature  in  the  bifurcation  diagrer 

is  th-  dv<  »> leaks  vvh-ch  pvA  the  ue*  er  and  lowe. 
b*  •  ••t?  .<■*'. ,  •-*  mss  t?---  iio  . .  uoinain.  The  dark 
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streaks  reprcser  *  values  a*  -  t.  a  probable 

and  visited  more  often  during  ii.e  iiuK-m  evolution. 
These  ordered  structures  were  <j-  covered  "expe.-.»ven- 
tally"  in  high-resoiution  graphs,  like  Figur**  3,  displaying 
hundreds  of  thousands  it  not  millions  ot  iterations  of  the 
logistic  map.  Once  discovered,  their  explanation  was 
found  to  be  simple  (12).  The  streaks  are  located  at  the 
future  values  of  the  "critical"  population,  x„  =  0.5.  The 
upper  bound  of  values  for  x  is  determined  by  the  heights 
of  the  inverted  parabolas,  i,  -  a/4,  as  diagrammed  in 
Figure  2,  and  the  lower  bound  and  all  the  interior  streaks 
in  Figure  3  by  the  subsequent  it.,aL->.  The  reason  that 
populations  have  a  higher  probability  of  passing  through 


High-resolution  computer  graphics  have 
enabled  inathematicians  to  identify 
ordered  patterns  which  would  otherwise 
be  buried  in  reams  of  computer  output 


values  near  the  trajectory  of  x0  =  0.5  is  that  the  slopes  of 
the  parabolas  on  the  return  maps  (Fig  2)  vanish  there, 
which  tends  to  compress  nearby  trajectories.  Moreover, 
the  intersections  of  these  dark  streaks  in  Figure  3  corre¬ 
spond  to  "crises"  in  the  chaotic  dynamics,  where  disjoint 
intervals  of  chaotic  orbits  collide  to  form  larger  regions, 
and  they'  have  been  a  topic  of  recent  research  (13).  The 
most  spectacular  crisis  is  readily  visible  at  a  ~  3  68. 

Tile  discovery  and  explanation  oi  such  reguh;  struc¬ 
tures  in  the  chaotic  detrain  is  not  just  an  amusing 
exercise  foT  experimental  mathematicians,  rather,  an 
understanding  of  these  probability  distributions  has  im- 
'  portant  practical  applications.  Since  an  analytical  de¬ 
scription  of  the  chaotic  evolution  of  individual  initial 
conditions  ir  impossible,  tne  best  we  can  hope  for  is  a 
statistical  theory  which  predicts  the  likelihood  of  the 
variable  t„  taking  on  anv  particular  value.  In  this  case  the 
"order  in  chaos"  which  is  apparent  in  Figure  3  plays  an 
important  ro’e  in  delineating  the  range  oi  validity  and 
the  structure  of  statistical  descriptions.  For  example,  in 
applying  this  analysis  to  the  evolution  of  biological 
populations,  we  '  ee  that  for  conditions  corresponding  to 
a  -  4  the  population  will  fluctuate  in  an  apparently 
andom  fashioi  over  the  entire  rang;.  but  is  most  likely 
to  lie  at  either  the  maximum  cr  minimum  values. 

And  the  standard  map 

cftir  second  example  of  a  nonlinear  dyn.i.iecal  system 
i>  hich  exhibits  a  transition  horn  regular  to  chaotic  behav¬ 
ior  is  the  standard  map  (14),  described  by  a  pair  of 
nonlinear  difference  equations 

*n>!  -  x„  +  y„*i  (2) 

V*.  i  -  y*  f  X  sir  xn  ,3) 

which  map  the  values  ol  the  two  variables  x„  and  y„  at 
time-step  n  into  i  „ ,  i  and  y„ *  i  at  time-step  n  +  1 .  In  (his 
i  ise  the  parameter  k  in  equation  3  controls  Ihe  i.iagr.i 
.,le  of  the  nonlmeerity 

This  map  can  be  used  tit  describe  .i  large  ream  lx  -  of 
physical  svxten.;  It  provides,  for  example,  an  a  v-.r..xi- 

■.i  t i. an  -.i.-rliM,  *  ■  lunv  S 


mute  dew  option  -1'  i  ..ne-iimiensional  motion  of  a 
cnaiged  ,  ettcle  peiti.;i-  f>  i  broad  spectrum  of 
0saluti',o  iix'ids,  .liX.  denote  the  position 

and  velocity  of  the  parties  a.  u  discrete  time  t  =  n  and  k 
is  a  measure  of  the  electric  field  amplitude.  It  also  arises 
naturally  as  an  approximate  description  of  general  one- 
dimensionaJ,  nonlinear  :isnllators  subject  to  periodic 
perturba lions  (hence  the  name  "standard  map"). 

As  Hie  nonlinear  parameter,  k,  is  increased,  the 
evolution  of  this  map  exhibits,  like  the  logistic  map,  a 
dramatic  transformation  from  regular,  predictable  mo¬ 
tion  to  chaotic,  statistical  behavior  As  a  consequence, 
detailed  numerical  and  analytical  investigations  of  this 
classical  mechanical  system  have  played,  and  continue 
to  play,  an  important  role  in  studies  of  the  microscopic 
foundations  of  classical  statistical  mechanics. 

The  simplest  physical  system  described  by  this  pair 
ol  coupled,  nonlinear  difference  equations  is  a  rigid 
rotor,  such  as  the  one  depicted  in  Figure  4,  which  is 
subject  to  sudden  kicks  at  regular  time  intervals.  In  this 
case  the  variable  x„  corresponds  to  the  angle  of  the  rotor 
and  y*  to  the  angular  velocity  immediately  after  the  nth 
kick,  and  equations  2  and  3  are  just  Newton's  equations 
for  this  classical  mechanical  system.  The  kick  can  be 
either  forward  or  backward,  depending  on  the  sign  of 
sin  xm  and  the  maximum  strength  of  the  kick  is  deter¬ 
mined  by  the  size  of  the  nonlinear  parameter,  k. 

Equations  2  and  3  provide  an  exact,  deterministic 
description  of  the  evolution  of  the  "phase-point"  (x„,  y„) 
in  the  two-dimensional  x-y  "phase-space"  which  is 
uniquely  determined  by  the  initial  condition  (x0,  y0).  For 
example,  if  we  set  It  =  0  and  look  at  the  motion  of  the 
rotor  at  st  Soscopic  intervals  of  time,  then  the  angular 
velocily  would  remain  constant  at  y„  ~  y0  and  the  angle 
x,  would  increase  by  y0  each  unit  of  time.  A  graph  of  the 
point  (x„,  y„)  in  the  x-y  phase-space  of  this  dynamical 
system  would  show  a  sequence  of  dm  lying  in  a 
straight,  horizontal  line  of  constant  y„  The  nrst  graph  in 
Figure  5  shows  a  computer-generated  "phase-space  por¬ 
trait"  (also  known  as  a  Poincar6  section)  for  several 
values  of  y0  with  k  =  0.  (For  convenience  we  have  taken 
advantage  of  the  natural  periodicity  of  the  angle  x  to 
restrict  the  range  of  x  to  the  interval  (0, 2ir)  by  evaluating 
equation  2  modulo  2ir.)  In  fact,  an  analytical  solution 
which  describes  this  regular  behavior  for  the  linear 
difference  equations  (linear  when  k  =  0)  can  easily  be 
determined.  However,  for  nonzero  k  the  standard  map 
is  no  longer  integrable  and  docs  not  admit  closed-form 
analytical  solutions  for  x„  and  y„  at  an  arbitrary  time  t  = 
n.  In  these  cases  we  must  rely  heavily  on  intuition 
derived  from  numerical  "experiments"  to  develop  new 
methods  of  analysis. 

We  can  exploit  several  symmetries  which  signifi¬ 
cantly  reduce  the  complexity  of  the  analysis.  The  first 
symmetry  is  the  fact  that  the  map  is  naturally  periodic  in 
y  with  period  2ir.  (If  we  increment  y  by  2-tt  on  both  sides 
of  equation  3,  its  value  remains  unchanged.)  We  have 
already  noted  fl  at  x  is  an  angle  variable  which  is  only 
defined  modulo  2ir.  Therefore,  for  the  purposes  of 
graphjc  analysis  it  is  convenient  to  evaluate  both  equa¬ 
tions  2  and  3  modulo  2ir  so  that  the  evolution  of  x„  and 
y„  is  restricted  to  a  square  in  the  x-y  phase-space  with 
sides  of  length  2ir. 

The  graphs  ir  Figure  5  show  phase-spr.ee  portraits 


Figure  3.  A  paradigm  in  lb*  field  of  iu*n«  ;\.r.*»mcv  thi*  b»ru'* 
cation  diagram  allows  the  lory; -time  hchavio*  of  :!•>•  loyjsiK 

map  for  values  of  a  between  3  5  ind  4.  The  graph  is  gener^td  h 
numerically  iterating  the  map  for  different  value's  of  and  ,  lofor.; 
several  hundred  successive  value*  o»  r.  a fter  in.*Ui  . *m>*  *!„t.’.  *  t.ave 
died  out.  The  result  is  a  graphic  display  of  *hr  umfo'fying  structure 
of  chaos  patterns  that  show  an  order’y  prpgue&Sicn  from  regular  ‘c 
chaotic  behavior  in  any  system  that  ran  be  modeled  by  equation  1 


rVnffv  the  i<.  (,  u'.l  «- volution  ui  'be  -^p  *u.v  e.-y.ts  >o  a  per  adic 
o-c.e  ot  peri  '  *’  &t  tjngrur.  yh.. «  •»  V  :.Vx*t'?  f  i!-*  >  for  x 
(at  a  3  5,  f  ”  .*\»r.»ple.  there  ar?  ‘our  d>scr**K  v  J*’v  fc»r  \;  the 
system  even *V5v  -v  .?!«  down  r  peno  *k  ovi'lahon  »monr 
tliwse  fo  '<  ?<]  >V’  ere  the  e*  olutioi.  iv  haotic  *V  ”  *1  •■.**«  •  *  » 
cover  <oi  tinuo.  ■  •nforvalv  ant'  th«»  da.kncss  of  the  shading 
represents  tb*  relative  probability  *hat  T  will  v?*;i  a  p*v**rulat 
rv^ion 


of  the  restricted  dynamics  for  increjsinv;  values  of  die 
nonlinear  parameter,  *.  This  senes  of  gisi'l.;  ck.u'iy 
shows  the  transition  horv  fguiar  to  . m.,gui,r  '•  ••• 

behavior  as  the  strength  ot  :t«  kick*  ib  ilKiViM  u  * 
speckled  region  ir»  the  graph  f.«  k  =  Z  is  ct.w.ed  h 
single  orbit.)  These  graphs  «.f  the  restricted  motion  -.r< 
extremely  useful,  since  initial  Conditions  that  >ho-.v  ,egu 
lar  or  chaotic  behavior  in  the  restricted  phase  space  will 
also  exhibit  regular  and  chach  behavio, ,  ■  .■  .  oh  a  ; 
the  unrestricted  dyajmes. 

A  second  important  |  lupcrty  which  ii  nptifies  t1-, 
mathematical  analysis  th.it  the  standard  iran  ,li.\e 
most  equations  describing  .  vhssipatnc,  'i .  ,w„.  ; 
charucaf  systems)  is  I  ,.in  at  a  •->,  ai  d  <»  »  v!,  , 

and  y,  |. .  s  ,»p- „  n.i •»  ■ 


ease  t<>  '.v  t.'.iiu,  cl  the  map  as  a  coo.  dilute 

trait*  term  iti,  from  variables  .  c„,  yn)  a)  variable? 

...  - roc..  ..I  i\Uiy  *.  ■  Iculus  we  know  ..rat  us  du  a 
.5..*-.g*  a  .n.-bics  infinites!  aa!  area.;  a.'-',  volumes 
*l. -  !  h  or  .00  tract  by  tire  Magnitude  of  ne  Jacobian 
•  t<  ,r(i '  of  the  .di'.vite  tianr.tcn  nation.  A 
r  .  •  at, on  of  j  for  th  .j'.dard  map  ..hows  that  it 

it  Ovj  „>1  ti  i  P.a:  property  permit ,  the  application  of  a 
...!•  s  ra  :  math  err  .uca,  .aethxh:  cr.d  theorems 

..  .  ilar.vi  „n  -ys terns  have  been  developed 

o..  .  i , *c  i  i  ,  i.Jr«-d  ui„  c.  dw  ..tudy  cf  celestial 

Oil  .  t>  ti.* 

!  .  'c-  .  ,ao  i,  nu.  -c.ig  .'itnamics  woo’  ‘ 

:•  ■•^acting  set  ir.  ■>h.  .  '.ce  with  a 

'  c  a  noir>:  u  or  com  pic 
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mar-Lfoi;'  n  ...  ..  .1  '  <tnn,.p 

attractor'  (6.  16).  in  our  simc»c  e*r..  •;  ••  -  a-i it- ; 

dissipation  *':r nn!  to  'ho  tree"  hr  v  •  terg  eqt:  <?':•.•  *  3 

hy  ' 

in~  i  *  "■>-!>-  /,  (-3) 

with  X  <  1  decreasing  the  velocity  each  tune-step  due  to 
friction,  then  in  the  absence  of  anv  kicks,  k  =  0,  every 
initial  condition  would  evolve  to  the  attracting  set  de¬ 
fined  by  the  line  )/  =  !'•  However,  for  large  enough 
values  o‘  .1  ate  kicks  can  .welcome  the  friction,  and  die 
-  ft  acting  set  can  he  much  more  complicated.  For  exam¬ 
ple,  the  upp^r  diag-am  in  Figure  6  shows  the  outline  of 
the  "strange  attractor"  for  X  •=  0.1  and  k  =  8.8  (17).  The 


v\'e  could  always  imagine  I’ut  in 
principle ,  by  stirring  very  carefully ,  we 
’an  separ.de  the  cream  from  the  coffee 
'liter  it  has  hem  thoroughly  mixed 


reason  lus  attracting  set  is  considered  to  be  strange  is 
hat  if  we  magnify  a  section  t  f  anv  strand  of  the  attractor, 
we  find  that  it  r-  composed  or  many  strands  which  in 
.  .m  am  oor.p  x-.l  of  many  str—Js,  ad  infinitum.  The 
si-cord  auigra:-*  in  Figure  ft  is  a  m.ignificativr,  cf  a  section 
of  .'us  attractor  *hrwmg  ‘his  "s,- if -similar"  .-iruanre  on  a 
smaller  Scale. 

TTsc  s Bruch.  *c  id  dimension  (which  :•  not  neccssar- 
u v  si  iru-cer,  u'  these  fa  .cinafinc  "fractal  attractors  are 
•  he  .vjojec*  •  i  f  much  cu  rent  research  it  nonlinear 
d>iwr:cs.  Tiois  lesearsh  nas  many  possible  applications, 
..-•eluding  the  description  chaotic  behavior  ir.  dissipa- 
...e  systems  «uch  as  turbulent  flows,  chemical  oscilla¬ 
tors.  or  neura1  networks  11)  the  interested  reader  should 
nek”  tr.  eo  <  "  -n*  *.  new  article  bv  Ed  Oft  116)  and  the 
beautiful  b-xV.  by  Benoit  Mandelbrot  (18). 

Returning  to  the  nondissipative  standard  map,  we 
ink*  that  in  ‘he  absence  of  an  attractor,  the  phase-point 
,a„,  v„i  can  in  prnciple  wander  anywhere  in  the  available 
.•base-space.  However,  we  have  seen  that  when  ir  =  0, 
the  v.  'jiutior-  •>/  the  phase-poin!  is  contmcd  to  a  hori- 
,  ootid  line.  For  nonzero  k  the  angular  velocity  is  per¬ 
turbed  b1'  ?,.>■..  and  to  bo  a  constant  of  motion. 

. > i  rn.git  expsvi  die  phase-point  to  explore  all 

•>:  ph.’.e  spa.  .*  Me  .erthvitss,  uie  phase-space  portraits 
r  Figure  5  c-.-ariv  -.how  that  this  ts  i..)t  necessarily  the 

'7iS*v* 

This  'Vo-  ■nn-.cntal"  result  is  further  substantiated 
t>.  a  c<-m  1’k.vle  'heorem  for  Hamilton! m  systems 
known  as  ttie  holmocorov,  Arnold,  Moser  (or  kam) 
-Uooren.  (IS  This  the  ireni  states  that  if  you  take  an 
ir.Vgrabie  Ham. (toman  system  (such  ns  the  standard 
.rap  with  y  !’t  and  add  a  nonmtegrable  perturbation  t k 
*  n.  then  •  •  offi-.r-titiv  sim!!  perturb.- tiens  approxi- 
.'tdtv  constants  ot  rioti  -n  will  survive  and  the  evolution 
.1  the  Jyivin-n  il  system  will  remain  regular  (if  some- 
•*  hat  du..orr--vii  t<  i  most  initial  conditions  Although  the 
h'  1  m,  i  i  in-.  proof  of  liiis  theorem  requires 
r.dt  tin  p.  .lu.Kilioi;  In-  vx.temelv  small  d."  Peruvai  has 
lescnb  I  -is  -  ..-tatnde  .is  i.T.oirabk-  to  u.e  'yi.ivitii- 
i-  >na.  • . .  in  A-is.r  s'-.i  'i  ■>  can  see 


ih.n  In  ir- ire  S  .r-e  ..e-soace  dibits  remain  quite 
a-jy  :  •'  .  ;•  ,'c.irlv  !u»g  •  vul.u-  o.  1  and  that  the  perturba- 
ti.  :>  me  ■:  become  ...h-.v  i.gc  Lefoie  the  evolution  of  a 
single  phase-trajectory  1-egins  to  iJi  large  regions  of 
phase-space,  as  it  does  in  the  graph  tor  k  =  2. 

In  practice  this  transition  from  mostly  regular  be¬ 
havior  to  global  chaos  as  k  is  increased  has  tremendous 
physical  significance.  For  example,  numerical  experi¬ 
ments  show  that  for  small  values  of  k  the  angular 
velocity  and  kinetic  energy  of  the  kicked  rotor  may 
increase  and  decrease  but  remain  confined  to  a  restricted 
range  of  values  for  all  time.  However,  for  large  values  of 
k  the  velocity  and  energy  can  wander  over  all  of  phase- 
space.  U  in  this  case  we  remove  the  restriction  to 
velocities  on  the  interval  [0, 2ir),  we  find  that  the  rotor's 
velocity  and  energy  can  wander  to  arbitrarily  large 
values.  Despite  the  fact  that  there  are  no  "random" 
forces  at  p;.y.  this  diffusion  in  energy  appears  for  all 
intents  and  purposes  to  be  a  random  walk.  Since  the 
standard  map  also  provides  a  model  for  the  interaction 
of  charged  particles  with  a  broad  spectrum  of  oscillating 
electrical  fields,  this  deterministic  diffusion  in  energy 
provides  an  important  means  of  heating  high-tempera¬ 
ture,  low-density-  fusion  plasmas  where  "random"  parti¬ 
cle  collisions  are  too  rare  to  mediate  in  the  irreversible 
transfer  of  energy  from  the  fields  to  the  particles  (29). 

The  numerical  experiments  indicate  that  this  transi¬ 
tion  from  confined  to  diffusive  motion  occurs  for  It,.  -  1. 
This  observation  has  led  to  (he  development  of  a  series 
ot  approximate  theories  of  ever  increasing  sophistication 
and  accuracy  for  predicting  the  critical  perturbation 
strength  for  the  onset  of  global  chaos  in  general  nonlin¬ 
ear  systems  At  present  the  best  theoretical  prediction 
(20)  for  the  standard  map  is  k,  s  63/64  =  0  984375, 
which  is  very  dose  to  the  best  numerical  estimate  (27)  of 
k,  ~  0.971635406. 

The  chains  of  elliptical  "island"  structures  which 
proliferate  at  k  ~  1  (Fig.  5)  plav  a  very  important  role  in 
determining  this  transition  to  global  stochashcity.  These 
regular  structures  in  the  nonlinear  dynamics  result  from 
resonances  between  the  motion  of  the  nonlinear  oscilla- 


Figure  4.  The  simples!  phy  sical  system  described  by  the  standard 
-nap  (equations  3  and  It  is  a  rigid  tjIoi  subject  to  periodic  kicks. 
The  tenm  a,  represents  the  angular  position  of  the  rotor  at  the  time 
ol  the  nth  kick;  v.  represents  the  angular  velocity  of  the  rotoc  just 
btlone  the  nth  kick.  The  strength  and  diiection  of  the  kirks  are 
determined  bv  B  '  cnlinv»c  tenn  t  sin 


Figure  5.  Phase-spare  portraits  (Poincare 
sections)  for  the  standard  map,  shown 
here  for  four  different  values  of  the 
nonlinear  parameter  k,  are  analogous  lo 
the  bifurcation  diagram  for  the  logistic  map 
(Fig.  1),  in  that  they  make  it  easier  to  see 
transitions  from  regular  to  chaotic  evolution. 
These  figures  are  generated  by  numerically 
iterating  the  standard  map  for  several 
different  initial  conditions  (>„,  i<„)  and 
plotting  several  hundred  of  the  succeeding 
points  U«,  yj  in  the  v- y  phase-space. 

The  graph  at  the  upper  lclt  shows  the 
regular,  intcgrable  dynamics  for  k  -z  0 
(which  corresponds,  in  F:g.  4,  t->  a  kick 
of  aero  strength,  so  that  (lie  artgrlar 
velocity  of  the  rotor  is  constant)  When  k  s 
increased  to  0  5,  the  trajectories  for  various 
initial  conditions  arc  still  regular  and 
nearly  intcgrable.  as  guarantee J  bv  (he 
Kolmogomff- Arnold- Moser  'heorem  for 
small  values  of  k.  A  mixture  of  ch*otic  and 
regular  traiectories  appears  wh  -n  >  n  t. 

The  graph  for  k  =  2  is  dominated  by 
chaotic  evolution-  a  single  trajectory 
can  wander  over  large  regions  ol  ph.rso. 
space,  although  some  islands  of  stability 
persist. 
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also  easy  tn  check  that  the  phase-point  in,  rr  i,  which  i’.es 
at  the  center  of  the  smaller  two- island  charn  across  the 
center  of  the  graph  tor  l  -  |  IS  tl  penodic  orbit  ol 
penod  2;  the  inferm.,.;. ife  values  of  the  n,lor  -m.j/e  and 
-elocity  correspond  to  the  point  (2tt,  it),  which  i  *h>* 
same  as  (0,  -.t)  because  ot  the  penodictv  ol  the  map. 

The  islands  surroundinr,  ’.hose  periotic  orbits  corre¬ 
spond  to  nearby  ort  is  whi.b  are  trapped  in  rem. 
resonances.  Since  tnc-  tnippid  orbits  wif  also  *>  .''-it. 
within  the  trapping  region,  die  fvnod  t  •>:  rtu;t<*tx-n  wiii 
also  generate  island  stmeturcs  witlnn  the^  nyular 
regions  and  these  island  -  in  Mim  will  sr:  i‘.  ..  ■  p •  ■*• 

island  chains,  ad  infinitum  Pork  ~  t  :hc*t*hi,v  _»  ■  ,!er 
resonances  are  extreme!-,  narrow  and  only  a  l  :v  .at  b 
discerned  at  the  ivscv  il.on  of  f  igure  5  i  fowevc-r,  using 
Hamiltonian  perturbation  theo.y  we  f.,id  th  .  die  ip<ji 
vidua]  island  chains  increase  in  width  as  k"  sc  we 


vidua]  island  chains  increase  in  width  as  ku 
would  expect  catastrophic  con'  vuences  when  k  r- 
1  In  fact,  the  disa  le.  evil  !  rru.'S  'tl.  (  I 
large  numbers  of  recon-u*.  os  :-,teraei  in  Irr 

global  chaos  (22). 

For  k  >  t  the  appro»;m.ite  constants  o‘  .t” 
destroyed  fo:  :n..-,t  imSai  co-'Odons,  -i.-.d  ;t 
sponding  ph.i-«  spru  e  ( r  tie.  t< nes  a no'  ipg, 
to  into  eh  i  o  -  ■  .1  >  -...iniirr  ... 


regions  o>  o'l.tse-spaoe  (like  the  cubit  for  k  =  2  in  Fig  3 
!n  the  rex  ivtion  1  will  simw  mat  these  orbits  exivbi. 
tf'c  s.-rwe  |«  •:  mutability  and  extreme  sensitivity  to  imti.u 
cT'diU'i'-  s  *he  .rregular  oriuts  of  the  logistir  map  and 
t'-  .  ■'  ,ir‘,<-:.'  u  dvnamics  mee  t  the  mdibuns  rcvjuired 

b\  .ie  <1  .  nhor.  ot  die  is.  In./orhinately,  few  rigorous 
mathemati  ai  resn'ts  are  ova  Table  at  present  ‘or  moder¬ 
ately  realistic  physical  models  like  the  standard  map: 
however,  dr.ee  the  .nap  van  he  easily  iterated  for  manv 
T.jllii-n>  ot  i. mo-steps  the  numerical  evndenoe  can  tx 
y.re  •'onveicing.  in  .  sci,  one  numerical  study  reported 
the  resuib-  •>(  a  crdculatio:.  with  as  many  as  10,:  itera¬ 
tions  ot  th.  staiKMrd  map  :2'i 

<  )ne  c ;  tht  ''t.oilties  ta.  ec  cry  a  ngomus  mthemaf- 
ic.-.i  .-‘r.alv-  -  ,v  th  ••:).}*•  .“e-s,.vce  :«  '.ft**  '  divide*’  *»t* » 
t-  ’h  n  jtt..jt  to*  •;  s  i.ins’ie  resonant  island  strut  ures) 
as  i*  nil  as  S'  a  •■••gsorts  for  most  reoJistic  systere.s.  In 
jorterular,  *  >t  •tirdard  rrap  already  exhibits  bands  of 
rive  or  orbits  tor  ’.  ca  small  values  of  k,  alth  ,gh  the 
i  vc  thc-.iry  guarantees  that  they  are  very  rutnow  Tltese 
inoviise  tn  sire  as  k  increases  until  k  e-ceeds  after 
-  '-’ch  he  naotic  regions  tx1  and  until  they  consume 
rr.  jt  of  pbise-r.pace.  Fot  e;  ample,  the  bands  of  chaos 
;n~"  toe.  to  be  se*n  r  Figure  5  when  k  -  0.5  but 

v*,>:r:  c  v.p. •.-.*»  ••(  k  ■  I  and  c<  -piate  the  phase-space 
*.t  k  2  Moreover,  peric-Jic  orbits  with  stable  island 
.'tnitt’ires  rias  .vsist  in  the  chaotic  regime.  For  exam- 
r>V.  r<eur *  5  st.-uvs  ’"a.  .to  island  of  stability  persists 
jih.-  .  tl.  at  In,  O'  *or  k  -  2;  however,  it 

■  m.  *t  o‘  avjy  t>v  the  chaotic  sea  when 


♦  A^r 


rhe  graph-,  c-f  *ht  m.-gutar  dynn  >,v:  ■■  fl 

logisr-  and  standard  i.  «,.•>  j.  jo--. a  ,  . -ure  p»k  •.  vc. 
chaos  l.i/.e  .  , , *  iOiuuko.  sv>.v-i,.,  _  .  .„lure,  those 
mathematical  models  exhibit  behavior  wh  eh  appears  to 
be  random  despite  the  fact  th.it  the  equations  ot  motion 
are  fvily  dete-mnlshc.  .  '  -  .,1.2005:1  are  fully 

determined  aod  the  syste...  •  arc  relatively  simple,  where 
does  this  complex  beh«  >:  come  from.’  What  are  the 
ymptoms  mat  afow  us  1  identify  chaos  when  we  see 
.f  And  wfsat  are  .he  real  differences  if  any,  between 
such  deteminisav  dtavcc  behavior  and  random  process¬ 
es’  To  descnbe  more  cieariy  thus  disease  called  classical 
maps,  we  must  delve  a  little  deeper  into  the  mathemati- 
al  theory  ot  uvnamica)  system 

We  have  ai  ready  defined  what  v.  a  mean  by  deter 
mvst'c  otha  '..,r  ,i\  •ivna.recv  sy-daras,  nan-iy,  thtir 
evolution  if  .  jrapleteiy  deten..;  ieJ  ■>  the  initial  condi- 
•nni  anil  the  evsitaHons  ;>*  mohoi-  prescribed  by  the  Laws 
of  pb'  s;cs.  nut  wh.il  do  we  mean  b\  random  behavior’ 
.'ur  intuitive  robin  a  random  orchards,  riiXtsy.  cuch 
us  the  roll  ot  a  lie.  the  flip  of  a  coin,  or  the  -.pin  of  a 
:ou!.-.tv  wheel.  >s  a  pi.,cess  which  exhibits  irregular 
oe'.mor  tha’  i  -  not  'IvV  owned  by  any  laws  and  defies 
ed-ton  u-i}  However,  bus  concept  would  not  be 
very  useful  if  were  no,  for  the  f.wt  that  tatisticai 
properties  01  ,  r  *.  >>.  rns,  -c  .  1 the  axciage  behav- 
vr  ovei  nn.i  a  tret  ,Vui,iy  repetitions,  trv  very  well 

des;-.i>  d  r ,  the  calculus  ot  probabilities  and  the  so- 
calied  taws  of  chancre  i24\  Therefore,  the  traditional 
dyflnit;*-  of  an  nJealicev,  :ar„;c, in  i,r,  in.. re  pit  ci.w’y, 
tivh  »- tic  r  ri  ;s  a  dv'n  1  .leal  s\ stem  wh  h  cm  be 
described  on.,'  u.  terms  nf  .nvrage  poip  'ihcs  deter¬ 
mined  by  1:1  appropriate  -irubabiiity  distribution. 

hi.n.'sticat  methods  oase-J  on  the  calculus  of  probi 
Mine*  -md  the  rnathemancai  iheor;,  s!.reha.>tic  pro¬ 
cess':..  inve  be  s  icc 'e , •■•hilly  appiie.’  to  „  wide  variety 
::i  phy  •>.  !  pm! 'sirs.  Tin.  mos,  sp.ctacului  example  is 
th>  the  *r>  t  cl.».>«ai  -tjtijtie.i,  ine.hanio,  developed  by 
Viiuv  ■!!.  BoiVnarn.  •‘ll.bbs,  «nd  I-iiistein,  it  provides 
■  in.  -n..!  ,  da- ion  t.  :  the  th>  ory  of  .ueimodvnam- 

.  s,  A'i.i  .1..,  at-.i.  descvtt*  >  »i.uch  of  the  macroscopic 
••t  rtci  ti  w<  -  r,  v.,-  r  >>w  have  two  ac, iithetxal  Uiscrip- 
■oi'.s  Di  ;hi  >»c  '  men  nf  nmi-re  iv  ••  in  s  f,as  or  atoms  in  a 
orv  ,  resit  •  <  •  fht  :*  ‘  ;  r>  h.ihilisti.;  and 
,c  r.o  ■  •..  ,,*r  >s  dal  »!  c  .  ins  >  .•  >t,itishcc.l 

-t  1  ■  .T".  ,  i.'ot  he  ■•o.iP'Oii  >0  K’l’v.-vo  n. 


,>  *-  >Jer  .  Jitmns  the  .m  cvu'ution  .»f  u 

i*)!  t  »  oamiti^  > v  fcir*  ji r  CfpnvrrRr  to  Attriclitm  H'l  in  phay.  • 
1 »  .  ,1  h-  1  ui  more  diiiu’it>ion>.  j  «.(ran^e 

-f'fdcib  1  1  r:*.rru  .  ■  if  ,-dci  t1i>*ipdron  ■  ,'f  fo  »t*P  rotor 

jrpic*.»J  ■'  iinu,*  •  in j?  « I  emotion  t  l!if 

j!  l>  «*  ttij'  r. the  stiinge  attrjil,  r  tot  ‘he  damped, 
ki<  ktfd  vv-  1  *v|»rn  a  ;  0  1  and  k  “  8. ft.  lire  lun,:  trrm  evolution  of 

’•  *  ••  !  •  *.  <*  !-•*  ♦*  ’»  nt.inr.'.r*  '  .ratify 

•  pi'’  ’  fl '.ru’-Vri  T>r  ilrT.itor  J 

•ri  j'iy  the  ^ n  f,ir  <i*7urt,  »e,  v;h»th  is  maintained  rn  all 
..  * '  d  .nuti  y,  r  ‘hi*  >bpxi  j  n'.iM.*»ege',  "tr-i  ns‘,  ' 

-  .  x-i  rh*’  .  •  ji  I  •  t'uilom  fni,',nmrt  ; r  c  <.^10.1 
ulovf'J  *’*>•  *h-  »v  td*}*‘*-  i  .  sht  f.  , 

,\  '■  Vn  sell  t  ru'  «  nh-j!  V  <  *  (S-j 
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cts  to  mi-.  p: :  ■r.aUli  ,iic  iaws  ol  siatis- 

?;  f-,.: . jrs  ...  •  unistie  iaws  ot  classical 

r.  . .  .  ,.  ve  Kr:h  o  ,.  i.'  ranch  of  mathematics, 

•_3t*V  1  ..'i^odic  theory,  wc...h  pr  ;des  a  means  of  classi¬ 
fying  diherent  deterministic  dynamical  systems  with 
irregular  behavior  (1 9,25,  26).  In  particular,  this  classifi¬ 
cation  scheme  defines  symptoms  for  a  hierarchy  of 
-..uerent  classes  of  randorn-like  behavior,  "statistical 
diseases.  '  of  increasing  severity. 

Dynamical  systems  with  the  mildest  disease  are 
called  ergodic  (25, 26).  These  are  systems  that  come  near 
almost  every  possible  state  over  time  but  do  so  in  a 
regular  manner.  For  example,  the  evolution  of  the 
standard  map  for  k  =  0  *s  completely  described  by 
equation  2,  since  the  angular  velocity,  y„,  is  a  constant  of 
motion.  If  the  Initial  angular  velocity,  yo,  is  an  irrational 
multiple  oi  i.rr,  then  the  angle  variable,  x„,  will  eventual¬ 
ly  cover  tire  entire  interval  (0, 2tr|  in  an  ordered  and 
predictable  way.  This  system  is  merely  ergodic. 

Although  there  has  been  considerable  confusion  in 
the  physical  literature,  ergodidty  alone  is  not  sufficient  to 
justify  the  application  of  the  probabilistic  methods  of 
statistical  mechanics,  since  ergodidty  alone  does  not 
assure  that  nonequilibrium  distributions  evolve  toward 
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equilibrium  (25,  2o).  1  lowever,  dynamical  sysienis  with  a 
more  severe  disease,  the  su-called  Kolmogorov  systems 
or  K-systems,  are  irregular  enough  to  rigorously  |ustity  a 
statistical  description  (26,  27). 

K-systems  exhibit  the  mathematical  property 
known  as  'mixing"  with  "positive  Kolmogorov-Sinai 
entropy.”  The  "mixing"  behavior  is  a  precise  character¬ 
ization  of  what  you  observe  when  you  stir  cream  in  your 
coffee,  although  many  nonlinear  dynamicists  prefer  the 
example  of  rum  and  Coke  (28).  "Positive  Kolmogorov- 
Sinai  entropy”  is  an  essential  technical  condition  which 
is  difficult  to  verify  directly  for  a  given  dynamical  system 
However,  in  practice  this  means  that  the  dynamical 
system  exhibits  extreme  sensitivity  to  initial  conditions, 
so  that  two  trajectories  started  at  nearby  initial  conditions 
diverge  at  an  exponential  rate.  This  rate  is  measured  by 
the  "average  Liapunov  exponent,"  which  is  equivalent 
to  the  Kolmogorov-Sinai  entropy  and  can  be  easily 
computed  (29,  V).  Because  of  this  extreme  sensitivity  to 
initial  conditions,  the  evolution  of  detei  ministic  K-sys 
terns  defies  long-time  pp  “diction  (like  the  weather),  since 
small  errors  ot  unrein unties  in  the  initial  conditions  give 
rise  to  time-evolutions  which  are  completely  different. 

We  can  now  define  chaos  as  the  behavior  of  deter¬ 
ministic  dynamical  systems  which  exhibit  these  symp¬ 
toms  of  mixing  behavior  ..,'i.  a  positive  Kolmogorov- 
Canai  entropy  or.  equivalently,  a  positive  average 
Liapunov  exponent 

For  example  to  on.  ‘  naps  (live  the 

logistic  map!  of  the  Inrrr.  \  ,  /tv„).  the  average 

Liaumov  ..  >•*  ■■■•  ■  dob:  ‘  to  i*» 


l 


li.'l 


(?) 


Figure  7  shows  a  graph 
o:  ninlr.tv 

'•hi’-  '  •  ■ 
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xus  r. 


:  the  same  range 
.  i-  dr'diVed  in  th. 
l  ine  ■  >■  srlv  ‘.'V  ' 

con >t  i .  and  pn.itr.i 
values  of  the  average  luuptino.  exponent  and  between 
periodic  orbits  and  harp  dips  in  A. 

In  particular  tin  a  -  4  the  avenge  Liapunov 
exponent  car  be  calculahxl  exactly  by  taking  advantage 
ot  a  remarkable  nx  rdffiate  tr  instorm^tior.  It  detre  a 
new  vanable 

v,  -■  (2/-rr; Set  (Vi„)  (A) 


then  the  logistic  uv  ,•  eqi  ation  1,  transforms  to  tlv  "teat 
tup" 


Vn»| 


- 
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0  <  .v,  --  0  5 
I'iS'.r-  1 
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Here  we  see  that  in  \Jt  u-.  hf  la  2  ioi  ail  x  so  mat  •  - 
In  2  —  0.693  .-»  0  Since  ibc  Kolmogorov -Sinn.  entropy  ;> 


Figure  7.  The  «v.  rwje  l  i;p'»«  rxpor.cnl  (X,  rqiution  5)  defii'-c  in 
precise  nuthenutui!  r wMsitivity  to  initial 
cofxUtaofis:  wfani  X.  is  „»n*;  in  *«  r^t.inia 

Iced  to  large  divergences  in  it*e  Imp  •  iti*»  evolution  Tit*  ^ve»-ige 
Liapunov  exponent  for  *j>jp  m  nufne.-ic^Jts  romf'.'ed 

and  plotted  here  frr  th*  urtr  >  i'uos  .  i  i  shown  in  Hfurt  3  ''ns 
V*ph  venfies  ifca*  h*»i  tr  Iig  ir**  V  4 

diagram,  wru^j ;  .  .ii  j«fti{,.c  -/jis  h.r  a,  *h<*iv*»  t  •n-Vc 

(periodic)*  *, 


invariant  under  coordinate  changes  (26),  this  prows  that 
the  logistic  map  with  n  -  4  is  a  K-sys!em  and  thereby 
meets  .>ur  definition  of  a  chaotic  dynamical  system  It 
can  also  he  ngorouslv  shown  that  the  logistic  map  is  a  K- 
system  and  therefore  chaotic  for  many  values  of  a  >  n , , 
=  3.57  which  i:,  consistent  with  the  numerical  e  a 
dence  displayed  in  Figure  7. 

The  average  Liapunov  exponent  can  also  be  calcu¬ 
lated  for  dynanucal  systems  in  higher  dimensions,  like 
the  standard  map,  although  the  algorithm  is  more 
complicated  than  that  tor  one-dimensional  maps  (3(6 


The  root  of  the  disease  lies  in  the 
mathematical  pathologies  of  the  real 
numbers 


For  example,  a  computation  of  the  average  Liapunov 
exponent  for  the  standard  map  shows  that  for  orbits  in 
the  regular  regions  ot  the  phase-space  of  Figure  5,  A  -  0; 
in  the  irregular  regions,  A  >  0.  Unfortunately,  very  few 
realistic  systems  have  been  rigorously  proved  to  be  K- 
systems.  Consequently,  the  justification  for  classifying 
much  irregular  behavior  as  chaos  depends  on  the  accu¬ 
mulation  of  numencal  evidence  and  on  experience  With 
a  few  idealized  mathematical  models  which  are  known 
to  be  K-systems. 

Using  tins  technical  definition  of  chaos,  we  now  se« 
tl.ul  h.iotic  dvnamical  systems  can  exhibit  man'-  of  the 
attributes  o!  idealized  random  systems,  namely,  their 
evolution  r  unpredictable  because  of  their  extreme  sen 
siiivity  to  initial  conditions,  and  their  average  propertn 
can  be  desuilxd  using  statistical  methods.  Hov  ever, 
when  we  ot'serve  irregular  phenomena  in  nature,  such 
as  !’ ibi.knt  (low  in  fluids,  we  don't  always  perform 
a--  r  .-gv-:  over  t; me  or  over  a  i  ensemble  of  initial  rondi- 
Cions,  ketii-  r.  we  often  obsei  .t  a  single  realization  of  the 
dynamical  process  evolving  from  a  specific  (theugh 
imprecisely  known)  initial  condition  which  nevertheless 
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appears  as  random  as  a  scqucmi  <?;  com  flips,  is  it 
possible  thac  detemunisac  but  chaoik.  dvn  nutal  sys¬ 
tems  can  also  account  for  the  random  appearance  of 
individual  realizations  of  these  ph.sica'  systems?  The 
answer  is  yes.  Using  the  definition  of  a  random  sequence 
provided  by  algorithmic  complexity  theory  (7),  we  will 
see  that  the  evolution  of  a  chaotic  dynamical  system  can 
be  indistinguishable  from  a  sequence  of  coin  flips  and 
that  these  completely  determined  systems  can  be  as 
irregular  as  any  idealized  random  system.  {This  latter 
conclusion  begs  the  question  of  whether  any  idealized 
random  systems  exist  in  the  world  of  classical  physics 
and  whether  the  apparent  randomness  we  observe  and 
exploit  in  statistical  theories  is  just  the  chaotic  behavior  of 
some  underlying  deterministic  dynamical  system.) 

Algorithmic  complexity  theory  defines  the  complex¬ 
ity,  K/v,  of  a  sequence  of  N  numbers  as  the  length  of  the 
shortest  computer  program  that  can  generate  the  se¬ 
quence  (7,31,32).  This  length  is  conveniently  measured 

Under  chaotic  conditions  the  use  cf 
pesticides ,  price  controls,  or  arms  control 
agreements  will  not  necessarily  yield  the 
desired  outcomes 


in  terms  of  the  number  ot  bits  of  information  required  to 
incut  the  program,  winch  is  proportional  to  the  number 
:>f  lines  of  Fortran  (or  any  other  programming  language) 
plus  the  ntir’be,-  of  bits  required  to  specify  any  numeri¬ 
cal  inputs  or  parameters  n  the  program,  such  as  the 
number  of  elements  in  the  sequence,  N.  In  particular, 
the  minimum  program  size  required  to  generate  a  se¬ 
quence  c;  numbers  of  length  ,V  is  at  least  log;  N,  since 
this  is  the  number  of  bits  required  to  specify  file  length  of 
the  sequence  in  binary  notation  Moreover,  if  we  consid¬ 
er  binary  sequences  of  Os  and  Is  so  that  an  output 
sequence  with  N  elements  corresponds  to  N  bits  of 
■•‘■formation,  tneri  the  maximum  value  for  K/v  is  of  the 
order  of  .V,  since  the  computer  program  can  simply  read 
;e  '.  bit  sequence  as  input  and  then  output  the  same 
-oquence.  (TTie  programming  commands  to  copy  the 
input  arid  only  .<  constant  contribution  to  K\,  which 
tre  :or  dtfteu-ri*  computers  but  is  negligibly  small  in 
th:  emit  of  large  V  I 

A  random  s>  queiuv  is  defined  to  be  a  sequence  with 
i  i«ima!  con-r'.Mfy,  K\  N.  A  nonrandom  sequence 
.an  be  generated  by  a  snorter  program  which  takes 
lUvantage  of  anv  order  or  regularity  in  the  sequence.  For 
f  -.UT.pte,  a  sequence  consisting  of  all  Is,  corresponding 
><  a  sequence  of  com  flip*-  where  heads  appears  every 
time,  can  be  generated  bv  the  computer  program  "Frint 
:,  N  times,"  which  can  be  programmed  with  —  log;  N 
‘•its  of  inform .iiv-n.  However,  a  sequence  of  Is  and  Os 
tn  ,io  apparent  .rdcr,  wliich  is  most  efficiently  gener¬ 
ated  by  simply  making  a  copy  of  it,  has  maximal 
complexity  Kv  .V 

This  defii'.j'i^i.  of  a  random  sequence,  which  arose 
the  work  of  Koimogorov,  Cii.itin,  and  Solmonov  in 
.formation  theory  31  32),  is  ,r.  complete  agreement 
■  h  <uir  ,'itu'  •  •  con  ep  ,»i  a  random  sequent:.  Cer¬ 


tainly  '  sequence  w  .,uv  apparent  order,  such  as 
consecutive  is,  would  o...  lx  considered  to  be  very 
random,  whereas  a  .sequence  .hat  has  no  regular  pat¬ 
terns  and  can  be  specified  onlv  by  a  program  of  length 
—  N  is  likely  to  meet  our  intuitive  criteria  for  random¬ 
ness.  In  fact,  for  infinite  sequences  Martin-L6f  has 
proved  that  these  random  sequences  will  satisfy  every 
conceivable  statistical  test  for  randomness  (32). 

What  then,  is  the  complexity  of  the  time-sequences 
generated  by  chaotic  dynamical  systems?  Consider  for 
convenience  the  one-dimensional  map  on  the  unit  inter- 

Val  x„+i=2x„  Modi  (8) 

which  is  closely  related  to  the  tent  map  and  consequent¬ 
ly  to  the  logistic  map  via  the  coordinate-transformation 
equation  6.  Using  equation  5,  the  average  Liapunov 
exponent  for  equation  8  is  easily  determined  to  be  In  2  > 
0;  so  this  map  is  a  K-system  and  therefore  chaotic.  Now, 
if  we  examine  the  action  of  this  chaotic  dynamical  system 
on  initial  conditions  represented  in  binary,  *o  = 
0.101001110100111...,  then  the  multiplication  of  q>  by  2 
just  shifts  the  "binary"  point  to  the  right  and  the  Mod  1 
throws  away  any  integer  part  of  z  to  the  left  of  the 
"binary"  point.  Therefore,  successive  iterations  of  this 
"register  shift"  simply  read  off  successive  binary  digits  in 
the  initial  condition.  In  particular,  if  we  call  "heads" 
when  the  value  of  x„  >  \  (i.e.,  the  leading  digit  is  1)  and 
"tails"  when  r„  <  j  (in  which  case  the  leading  digit  is  0), 
then  the  evolution  of  the  map  will  generate,  from  every 
initial  condition,  a  sequence  of  heads  and  tails  which 
resembles  the  tossing  of  a  coin.  But  when  will  these 
sequences  appear  random?  The  answer  is  again  provid¬ 
ed  by  Martin-Lof,  who  also  proved  that  almost  all  initial 
conditions  on  the  unit  interval  have  a  random  binary 
digit  sequence  (32).  Therefore,  the  deterministic  shift 
map  will  almost  always  generate  a  random  sequence 
which  is  indistinguishable  from  the  outcome  of  an 
idealized  coin  toss.  Moreover,  the  same  conclusions  can 
be  generalized  to  the  tent  map  (and  equivalently  the 
logistic  map)  and  all  other  chaotic  dynamical  systems. 
(Of  course  if  you  try  to  implement  equation  8  on  a  digital 
computer,  only  short  sequences  can  be  studied,  because 
the  shift  map  quickly  runs  into  the  precision  limits  of  the 
computer,  which  represents  initial  conditions  with  only 
~  30  or  60  binary  digits  in  single  and  double  precision, 
respectively.) 

Is  physics  conquering  chaos,  or  chaos 
undermining  pnysics? 

The  definitions  and  examples  in  the  previous  sections 
show  that  nonlinear  dynamical  systems  can  exlubit  all 
the  attributes  of  an  idealized  random  process.  Moreover, 
the  thoon  of  algorithmic  complexity  reveals  that  the 
origins  of  chaotic  behavior  in  nonlinear  dynamical  sys¬ 
tems  and  perhaps  in  nature  itself  lie  in  the  randomness 
of  almost  all  real  numbers. 

In  other  words,  chaotic  dynamical  systems  are 
mathematical  models  which  "read"  initial  conditions. 
They  are  like  the  compulsive  librarians  in  Borges's 
Library  of  Babel  (where  books  containing  every  possible 
combination  of  letters  are  shelved),  who  read  ever)’ 
word  and  character  in  the  books  under  their  care, 
>  hereas  regular  or  n.mchaotic  systems  arc  like  the 


Figure  8,  On  th*  New  iork  Stock  (whang*.  the  use  of  computers 
has  decreased  the  frenzied  shouting  on  the  floor  while  increasing 
the  volume  of  trading — but  prices  seem  more  volatile  than  ever. 
Even  if  the  prices  of  stocks  are  completely  determined  by  initial 
conditions — that  is,  if  the  system  is  mechanistic — the  behavior  of 
the  market  on  a  given  day  might  still  satisfy  the  mathematical 
definition  of  chaos.  There  would  be  no  faster  way  to  compute  the 
outcome  than  to  watch  the  market  itself  perform  on  that  day 
(Photograph  c  Four  By  Five.) 


casual  readers,  who  just  ivao  the  titles  and  skim  the  text 
(33).  The  unpredictability  of  chaotic  dynamical  systems 
arises  from  the  fact  that  slight  errors  or  changes  in  the 
initial  conditions  correspond  to  different  books  in  the 
library  which  tell  different  stories 

More  generally,  if  nonlinear  models  describing  the 
evolution  of  biological  populations,  economic  prices, 
armament  stockpiles,  or  turbulent  flows  in  fluids  can 
exhibit  chaotic  behavior,  then  vve  may  be  incapable,  in 
practice,  of  predicting  the  behavior  of  the  e  systems  or 
their  response  to  external  h-nei.  since  any  errors  or 
perturbations  will  grow  exponentially,  for  example, 
under  chaotic  conditions  the  use  of  pesticides,  pnee 
controls,  or  arms  control  •  cement';  will  not  necessarily 
yield  the  desired  outcomes  d  ig  8). 

Another  manifestation  of  the  unpredictability  of 
chaotic  dynamical  ''a*  fNe  rime -evolution  is 

vomp-.i'aticnallv  u\  d  ■  \  in  •:->  is  no  faster 

way  of  finding  out  Innv  mi  -vs'!  evolve  than 

to  watch  its  evolution  '  h  n.uru.'al  'vM-xm  .(sell  is  its 
own  fastest  computer.  '  1  k>-,  i.j  the  l.  ib.aiv  of 

Babei  the  only  way  yvo  i.  .  ectate  the  contents  is  to 
read  the  en.ire  book  ti.  the  .-nJ  (Uiifommatelv,  most,  in 
tart  almost  all.  ot  thv  ho.  k  .  ppcar  to  be  gibbensh  and 
make  ven' uninteii'sl  ”  ‘i*av  -c  somewhere 

in  the  library  is  a  col'.  .  '  con-'ens  the 

i on  p'  -te  pis  ,  "J  i  it  u.v'TSf.) 

Chaotic  dynan.ii.ii  .  >.  •.:«  r;  *  arc  also  like  football 
games.  Even  with  the  largest  imaginable  digital  comput¬ 
er  you  could  not  predict  the  outcome  with  cvrt.vntv.  The 
players  themselves  provide  the  fastest  analog  computa¬ 
tion  of  the  evolution  of  this  d'/namical  system  Because 
of  the  complexity  and  unpredictability  of  chaos,  direct 
numerical  simulations  o!  football  games  and  turbulent 
flows  are  likely  to  remain  impractical  with  even  the 
largest  supercomputers  He  's  ever,  we  can  nevertheless 
compute  reliable  odds  m  probabilities  for  tne  outcomes 
of  these  processes.  As  a  consequence,  probabilistic  and 
statistical  theones  provide  a  natural  description  of  aver¬ 
age  properties  ot  chaotic  dynamical  systems  .  Vr.  enter¬ 
taining  account  of  how  several  well-known  cha  '*  theo¬ 
rists  used  their  knowledge  of  nonlinear  dynamics  t> 
improve  their  odd?  at  roulette  is  provided  in  ref  35  ) 

One  of  the  most  surprising  properties  of  chaotic 
dynamical  systems  is  'hat  tne«e  deterministic  models  are 
often  very  simple  The  realization  that  complex  ber.,vior 
does  not  require  o  r.plec  nvcht -matiral  mo-Hs  is  i.  :x  o 
the  most  signi/icanl  contributions  of  nonimeai  dynam¬ 
ics.  Since  simple  mode!,  cat,  yield  complex,  irregular 
behavior,  we  can  actually  hope  to  develop  ttvoretirai 
descriptions  of  a  w-.J,  van.  tv  of  apparently  lanoom 
unpredictal’it  natu..b  >inena  using  inathematn  V 
models  wl  .  h  .  ■.!  Ji  .  ■  mirKtii  cons.  Jtrw’vr 


ahnovph  recent  progress  ha1-  suggested  partial  solutions 
to  *hv  ninetecnih-cc-ntury  problems  of  the  origin  of 
turb’honce  1  -  tivids  a.nd  the  microscopic  foundations  of 
statistical  mech'.sus.  many  old  problems  remain,  and 
some  new  md  very  profound  questions  have  bee 
ra,  -ed 

f  or  example  among  the  old  problems,  the  discov¬ 
er,  >f  chan-  l  os  not  mimculousiy  solved  the  problem  of 
ti  d'u:,  "(c  so  !";eidr  J3.it  v.e  now  have  new  methods  of 


There  is  no  faster  way  of  finding  out  how 
a  chaotic  system  vnli  evolve  than  to 
i  hell  d  -  ev'  dion.  The  system  itself  is 
its  aim  ms  test  computer’ 


chttorterizij  -  nrH  oi  behavior,  such  as  the  measure- 
ircn*  of  t. -e  .ver.igc  Liapunov  exponent  or  .he  fractal 
d.  ii’ps.v  r  o‘  the  stra’-ve  atract''-  associated  with  turbu- 
lemt  and  we  have  a  much  beriei  unders'.indir'g  of  why 
the  theoretical  and  numerical  description  of  the  evolu- 
tio  .  ot  ti:rt ..Pen'  flows  is  so  c'iffio."*  (35). 

M(w.-..i,  a  I  tl  tough  ch,v.  explains  how  average 
pr.  ;x  -m-s  of  nonlinear  dynamical  systems  can  exhibit  an 
ir.<-  -sihle  appro*  h  tr  therrr,  xfynamic  equilibrium,  it 
d  ri.v  .x,ut  '  to;  wav  ind  dual  systems  in  nature 


dl  l  :’l,pCci|  <-xh.  ii'.  the 
e-.i  bv  ,hr  mv. md  law 
tv.  'tors  ot  rnotif-n  -i,. 


m.'v  i  r.  ;He  evolution  mandat- 
t|."nnodynamics.  Since  the 
a  mechanics  are  determin- 


^  and  invariant  under  rime-reversal,  we  could  alway 
iTi.v’ro  p-  ■  n  pnrrtple.  hv  stirrinc  vcy  carefully,  wt 
can  ..  u  .  v-mr-.  t  re  rh«*r  it  has  beer 
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thoroughly  raif  i  411  thr:  -norjmc.)  •  uvnam  cs  tells  us  ;s 
that  this  reversal  of  time-evolution  w\I;  tv  extremely 
difficult,  since  any  enters  or  uncreiain'i  s  will  guarantee 
failure.  The  micsing  irgrdknt  '»><:,  !re.i  nr  a  complete 
justification  of  the  foundations  of  classical  statistical 
mechanics  is  an  argument  for  why  such  errors  are 
inevitable.  (Certainly,  anv  numerical  simulation  of  the 
evolution  and  reversal  of  a  chaotic  dynamical  system  will 
tail  to  recover  the  initial  state,  because  whenever  the 
machine  rounds  off  a  number  it  automatically  introduces 
a  slight  change  in  the  system  which  gives  a  completely 


What  are  the  real  differences,  if  any, 
between  deterministic  chaotic  behavior 
and  random  processes  ? 


liitferent  and  unpredictable  result.)  A  provocative  dis¬ 
cussion  of  the  relationship  of  chaos  to  the  second  law  of 
rieirrodynanucs  can  be  found  in  lYigogine  and  Sten- 
pers's  Order  out  of  Clues  (37). 

While  confronting  these  remaining  problems,  non¬ 
linear  dynamics  has  also  identified  some  new,  uniquely 
twentieth-century  problems  which  ma,  account  for 
some  of  these  failures.  The  firsi  problem  is  that,  since 
chaotic  dynamical  systems  essentially  read  initial  condi¬ 
tions.  they  are  exquisitely  sensitive  to  the  infinities  and 
'rfmitesimais  manifest  in  the  continuum  of  real  numbers 
wn.th  underlie  almost  all  mathematical  descriptions  of 
natural  pheno  mena  In  contrast,  regular  systems,  such 
c?  those  siudnd  m  almost  every  textbook,  are  relatively 
insensitive  .0  the  mathematical  pathologies  ot  infinitely 
long  dig.t -strings 

Tlie  difficulty  witii  the  continuum  of  real  numbers 
lies  tr,  the  fact  that,  although  most  real  numbers  can  be 
proved  ‘0  have  random  digit-strings,  it  is  impossible  to 
peeve  that  a  given  digit-stnng  is  random  You  simply  can 
never  exhaust  all  the  possible  tests  (or  underlying  o.der. 
This  is  a  specific  example  of  a  eass  of  true  statements 

■  bich  cannot  fx  proved,  statements  first  shown  to  exist 
by  Grvjei  in  his  celebrated  incc  mplcteness  theorem  (3S). 

her  a  dear  discussion  of  the  connection  between  ran¬ 
dom  digit-string'  and  Cc-del's  incompleteness  theorem, 
•  v  1  Mi.  Moreover,  by  definition  these  number. 

■  not  U-  loniputed  by  any  aigontlun  shorter  than  the 
straig  itscli  4s  n  <u -sequence.  most  real  numbers 
::v  i.m\  mputahle.  Thar  tore,  r.w  that  our  understand 
m  •!  ihaotic  dvoarnic.it  < -stems  lias  revealed  that  the 
ci  *he  disc  rsc  lips  m  tbpso  maih'-matical  pathologies 
■'  .he  real  numbers,  Joe  ford  has  suggested  that  these 
.  rionpi.tible  and  undefinabte  objects  should  be  cx- 
M-d  lorn  anv  meaning:. ;1  physical  theory  (7).  In  addi- 
n  to  providing  some  logical  cursistency  in  the  desenp 
■n  '  r.jt'T >'  of  enoiriPii.i,  fhi,  restriction  might  1I30 
•h-hU  :he  n<i>  eig  argument  tor  th*  validity  of  the 
>n  l  lais  ot  ilurmod  vn.imns  for  example,  if  we 

■  -  -un  i  that  oaUire  ts  a  finite-state  '  onipotn-  (or  Turing 

ichi-v-t  tfu  r'  f.e  u'— .  oahle  tr.o.'.  rooc-  ot  real  numbers 
..Id  pro'  :Je  '!».■  i  o  m -graining  n.-  ess.irv  !  1  ensure 
,  -ni1  ■r-i,'i,.‘.  ot  1  h.n  t , >  syv  P's 

snv'  i  -  *  1  v  ■  o  •  !■.  t-  -i!d  a  -i"  •  ’•■.hr  • 


ip.  natural  sciein y,  1  .  i.amh  r  ot  reward!  groups  have 
air  !■.  begun  to  explore  >e  possibilities  of  so-called 
ceiljlai  automata  :<  odeis  tor  natural  phenomena  which 
are  defined  on  discrete  sets  of  numbers  (.>54).  I  lowever,  it 
is  possible  that  the  scale  at  which  the  truncation  of  real 
numbers  occurs  may  be  so  small  that  no  practical 
consequences  o'  the  distinction  between  continuum  and 
discrete  theories  can  be  deduced  or  verified.  In  that  case 
the  issue  of  the  ultimate  discretization  of  the  real  world 
will  pass  from  the  domain  of  physics  to  that  of  philoso¬ 
phy.  Nevertheless,  cellular  automata  are  a  fascinating 
subject  in  their  own  right  and  promise  to  play  an 
important  role  in  future  studies  of  nonlinear  dynamical 
systems. 

The  second  fundamental  question  which  arises 
from  our  ’reproved  understanding  of  classical  nonlinear 
systems  is  whether  chaos  persists  in  microscopic  physi¬ 
cal  systems,  such  as  atoms  and  molecules,  where  the 
theory  of  quantum  mechanics  is  expected  to  apply 
(40, 41).  The  difficulty  here  lies  in  the  fact  that  the 
Schrodinger  equation  for  the  evolution  of  the  quantum 
mechanical  wave  function  is  a  linear  equation  which, 
strictly  speaking,  is  incapable  of  exhibiting  the  chaotic 
behavior  of  nonlinear  classical  systems.  Since  quantum 
mechanics  is  presumed  to  be  the  fundamental  theory  for 
all  physical  systems,  and  since  the  predictions  of  quan¬ 
tum  theory  must  agree  with  those  of  classical  mechanics 
at  the  limit  of  the  highest  quantum  numbers,  according 
to  Bohr's  correspondence  principle,  one  of  these  physical 
descriptions— classical  chaos  or  quantum  mechanics— 
threatens  to  undermine  the  other.  Does  this  mean  that 
the  role  ot  classical  chaos  in  explaining  the  ongins  of 
turbulence  and  the  foundations  of  statistical  mechanics  is 
merely  an  illusion?  That  Bohr's  correspondence  principle 
is  invalid  for  systems  that  are  classically  chaotic?  And 
that  there  isn't  any  problem  with  the  continuum  of  real 
numbers  after  all? 

The  answers  to  these  questions  are  naturally  the 
goals  of  much  current  research.  Preliminary  results 
indicate  that  the  evolution  of  the  quantum  mechanical 
wave  function  appears  to  mimic  chaotic  behavior  for 
very  long  times  (42, 43),  in  many  cases  longer  than  the 
age  of  the  universe  (44).  Nevertheless,  without  chaos  we 
have  lost  some  of  the  necessary  ingredients  for  the 
foundations  of  statistical  mechanics.  The  validity  of  the 
correspondence  principle,  which  guided  the  early  devel¬ 
opment  of  quantum  mechanics,  also  remains  an  out¬ 
standing  problem,  although  recent  experiments  on  the 
ionization  ot  highly  excited  hydrogen  atoms  exposed  to 
intense  electromagnetic  radiation  (which  study  the  be¬ 
havior  of  a  quantum  system  that  is  classically  chaotic) 
suggest  that  the  correspondence  principle  is  remarkably 
rebus*  (4i,  46). 

In  conclusion,  we  have  seen  how  deceptively  sim¬ 
ple  mathematical  models  for  nonlinear  dynamical  sys¬ 
tems,  like  the  logistic  and  standard  maps,  have  provided 
new  hope  for  the  description  of  the  complexity  and 
chaos  which  surround  us  in  the  natural  world.  Howev¬ 
er,  these  and  more  recent  studies  have  also  opened  a 
Pandora  s  box  of  new  problems  wlrich  ask  profound  and 
disturbing  questions  about  the  proper  mathematical 
d-  scription  ol  both  macroscopic  and  microscopic  natural 
phenomena  and  whith  premise-  to  lie  at  the  forefront  of 
.•■'tific  reset-el-  m.inv  vears  to  come. 
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Recently  research  has  shown  that  many  simple  nonlinear 
deterministic  systems  can  behave  in  an  apparcndy  unpre¬ 
dictable  and  chaotic  manner.  This  realization  has  broad 
implications  for  many  fields  of  science.  Basic  develop¬ 
ments  in  the  field  of  chaotic  dynamics  of  dissipative 
systems  are  reviewed  in  this  article.  Topics  covered  in¬ 
clude  strange  attractors,  how  chaos  comes  about  with 
variation  of  a  system  parameter,  universality,  fractal  basin 
boundaries  and  their  effect  on  predictability,  and  applica¬ 
tions  to  physical  systems. 


IN  THIS  ARTICLE  WE  PRESENT  A  REVIEW  OF  THE  FIELD  OF 
chaotic  dynamics  of  dissipative  systems  including  recent  devel¬ 
opments.  The  existence  of  chaotic  dynamics  has  been  discussed 
in  the  mathematical  literature  for  many  decades  with  important 
contributions  by  Poincare,  Birkhoff,  Cartwright  and  Littlcwood, 
Levinson,  Smale,  and  Kolmogorov  and  his  students,  among  others. 
Nevertheless,  it  is  only  recently  that  the  wide-ranging  impact  of 
chaos  has  been  recognized.  Consequently,  the  field  is  now  undergo¬ 
ing  explosive  growth,  and  many  applications  have  been  made  across 
a  broad  spectrum  of  scientific  disciplines — ecology,  economics, 
physics,  chemistry,  engineering,  fluid  mechanics,  to  name  several. 
Specific  examples  of  chaotic  time  dependence  include  convection  of 
a  fluid  heated  from  below,  simple  models  for  the  yearly  variation  of 
insect  populations,  stirred  chemical  reactor  systems,  and  the  deter¬ 
mination  of  limits  on  the  length  of  reliable  weather  forecasting.  It  is 
our  belief  that  the  number  of  these  applications  will  continue  to 
grow. 

VV'e  start  with  some  basic  definitions  of  terms  used  in  the  rest  of 
the  article. 

Disstpative  system.  In  Hamiltonian  (conservative)  systems  such  as 
arise  in  Newtonian  mechanics  of  particles  (without  friction),  phase 
space  volumes  arc  preserved  by  the  time  evolution.  (The  phase  space 
is  the  space  of  variables  that  specify  the  sure  of  the  system.) 
Consider,  for  example,  a  two-dimensional  phase  space  {q,  p),  where 
q  denotes  a  position  variable  and  p  a  momentum  variable.  Hamil¬ 
ton’s  equations  of  motion  take  the  set  of  initial  conditions  at  time 
t  =  t0  and  evolve  them  in  time  to  the  set  at  time  t  =  r,.  Although  the 
shapes  of  the  sets  are  different,  their  areas  are  the  same.  By  a 
dissipative  system  we  mean  one  that  does  not  have  this  property 
(and  cannot  be  made  to  have  this  property  by  a  change  of  variables). 
Areas  should  typically  decrease  (dissipate)  in  time  so  that  the  area  of 
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the  final  set  would  be  less  than  the  area  of  the  initial  set.  As  a 
consequence  of  this,  dissipative  systems  typically  are  characterized 
by  the  presence  of  attractors. 

Attractor.  If  one  considers  a  system  and  its  phase  space,  then  the 
initial  conditions  may  be  attracted  to  some  subset  of  the  phase  space 
(the  attractor)  as  time  t  — ►  «.  For  example,  for  a  damped  harmonic 
oscillator  (Fig.  la)  the  attractor  is  the  point  at  rest  (in  this  case  the 
origin).  For  a  periodically  driven  oscillator  in  its  limit  cycle  the  limit 
set  is  a  closed  curve  in  the  phase  space  (Fig.  lb). 

Strange  attractor.  In  the  above  two  examples,  the  attractors  were  a 
point  (Fig.  la),  which  is  a  set  of  dimension  zero,  and  a  closed  curve 
(Fig.  lb),  which  is  a  set  of  dimension  one.  For  many  other  attractors 
the  attracting  set  can  be  much  more  irregular  (some  would  say 
pathological)  and,  in  fact,  can  have  a  dimension  that  is  not  an 
integer.  Such  sets  have  been  called  “fractal”  and,  when  they  are 
attractors,  they  arc  called  strange  attractors.  [For  a  more  precise 
definition  see  (7 ).  ]  The  existence  of  a  strange  attractor  in  a  physically 
interesting  model  was  first  demonstrated  by  Lorenz  (2). 

Dimension.  There  arc  many  definitions  of  the  dimension  d  ( 3 ' 
The  simplest  is  called  the  box-counting  or  capacity  dimension  and  is 
defined  as  follows: 


d  = 


lim 

t— 0 


In  N(t) 
ln(l/t) 


(1) 


where  we  imagine  the  attracting  set  in  the  phase  space  to  be  covered 
by  small  D-dimcnsional  cubes  of  edge  length  c,  with  D  the 
dimension  of  the  phase  space.  N(t)  is  the  minimum  number  of  such 
cubes  needed  to  cover  the  set.  For  example,  for  a  point  attractor 
(Fig.  la),  N(e)  =  1  independent  of  e,  and  Eq.  1  yields  d  =  0  (as  it 
should).  For  a  limit  cycle  attractor,  as  in  Fig.  lb,  we  have  that 
N(t)  —  €/t,  where  (  is  the  length  of  the  closed  curve  in  the  figure 
(dotted  line);  hence,  for  this  case,  d  =  1,  by  Eq.  1.  A  less  trivial 
example  is  illustrated  in  Fig.  2,  in  the  form  of  a  Cantor  set.  This  set  is 


FIB.1.(«)  Phase-space  diagram  for  a  damped  harmonic  oscillator,  (b)  Phase- 
space  diagram  for  a  system  that  is  approaching  a  limit  cycle. 
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Fig.  2.  Construction  of  a  Can¬ 
tor  set. 


i 


Fig.  3.  Poincare  surface  of 
section. 


Fig.  4.  The  Henon  chaotic 
attractor  <*l  Full  set.  (b) 
Enlargement  cf  region  de¬ 
fined  hv  the  rectangle  in 
(a)  |C'  Enlargement  of  re 
gion  defined  bv  the  rectan¬ 
gle  in  (b) 


fixmed  by  raking  the  line  interval  from  0  to  1,  dividing  it  in  rhirds, 
then  discarding  the  middle  third,  then  dividing  the  two  remaining 
thirds  into  thirds  and  discarding  their  middle  thirds,  and  so  on  ad 
intinitum.  The  Cantor  set  is  the  closed  set  of  points  that  are  left  in 
the  limit  of  this  repeated  process.  If  we  take  t  »  3'"  with  n  an 
integer,  then  we  see  that  >/(«)  «  2"  ana  Ecj.  1  (in  which  t-*0 
corresponds  to  n  —  »)  yields  d  =  (In  2)/(ln  3),  a  number  between  0 
id  1,  hence,  a  fractal.  The  topic  of  the  dimension  of  strange 
attract  on  is  a  large  subject  on  which  much  research  has  been  done. 
One  of  the  most  interesting  aspects  concerning  dimension  arises 
from  the  fac*  that  r'-e  distribution  of  points  on  a  chaotic  attractor 
can  be  nonun'f  >nn  wi  a  very  singvlar  way  In  particular,  there  can  be 


an  arbitrarily  fine  scalci  interwoven  structure  of  regions  w  here  orbit 
trajectories  are  dense  and  sparse.  Such  attractors  have  been  called 
multifractals  and  can  be  characterized  by  subsidiary  quantities  that 
essentially  give  the  dimensions  of  the  dense  and  sparse  regions  of  the 
attractor.  In  this  review  we  shall  not  attempt  to  survey  this  work. 
Several  papers  provide  an  introduction  to  recent  work  on  the 
dimension  of  chaotic  attractors  (3-5). 

Chaotic  attractor.  By  tins  term  we  mean  that  if  we  take  two  typical 
points  on  the  attractor  that  are  separated  from  each  other  by  a  small 
distance  A(0)  at  t  =  0,  then  for  increasing  t  they  move  apart 
exponentially  fast.  That  is,  in  some  average  sense  A(f)  ~  AlO)exp(lit) 
with  h  >  0  (where  h  is  called  the  Lyapunov  exponent).  Thus  a  small 
uncertainty  in  the  initial  state  of  the  system  rapidly  leads  to  inability 
to  forecast  its  future.  [It  is  not  surprising,  therefore,  that  the 
pioneering  work  of  Lorenz  ( 2 )  was  in  the  context  of  meteorology.] 
It  is  typically  the  case  that  strange  attractors  arc  also  chaonc 
[although  Jtis  is  not  always  so;  see  (/,  6)]. 

Dynamical  system.  This  is  a  system  of  equations  that  allows  ore,  in 
principle,  to  predict  the  future  given  the  past.  One  example  is  a 
system  of  first-order  ordinary  differential  equations  in  time,  dx.t)! 
i it  =  G(x,r),  where  x(t)  is  a  D-dimcnsional  vector  and  G  is  a  D- 
dimcnsional  vector  function  of  x  and  t.  Another  example  is  a  map. 

Map.  A  map  is  an  equation  of  the  form  x,.  |  =  Fix,),  where  the 
“time’’  t  is  discrete  and  integer  valued.  Thus,  given  x,,,  the  map  gives 
xt.  Given  x(,  the  map  gives  x;,  and  so  on.  Maps  can  arise  in 
continuous  time  physical  systems  in  the  form  of  a  Poincare  surface 
of  section.  Figure  3  illustrates  this.  The  plane  .rj  =  constant  is  the 
surface  of  section  (S  in  the  figure),  and  A  denotes  a  trajectory  of  the 
system.  Every  time  A  pierces  S  going  downward  (as  at  points  A  and 
B  in  the  figure),  we  record  the  coordinates  (Jfi.Xj).  Clearly  the 
coordinates  of  A  uniquely  determine  those  of  B.  Thus  there  exists  a 
map,  B  =  F(A),  and  rhis  map  (if  we  knew  it)  could  be  iterated  to 
find  all  subsequent  piercings  of  S. 


Chaotic  Attractors 

As  an  example  of  a  strange  attractor  consider  the  map  first  studied 
by  Henon  (7): 

x„,|  =  a  -  .x;  +  Py,  (2) 

> .  t  =  x„  (3) 

Figure  4a  shows  the  result  of  plotting  104  successive  points  obtained 
by  iterating  Eqs.  2  and  3  with  parameters  a  *  1.4  and  (3  =  0.3  (and 
the  initial  transient  is  deleted).  The  result  is  essentially  a  picture  of 
the  chaotic  attractor.  Figure  4.  b  and  c,  shows  successive  enlarge¬ 
ments  of  the  small  square  in  the  preceding  figure.  Scale  invariant. 
Cantor  ser-likc  structure  transverse  to  the  linear  structure  is  evident. 
This  suggests  that  wc  may  regard  the  attractor  in  Fig.  4c.  for 
example,  as  being  essentiailv  a  Cantor  set  of  approximately  straight 
parallel  lines.  In  fact,  the  dimension  d  in  Eq.  1  can  be  estimated 
numerically  (&)  to  be  d  a  1.26  so  that  the  attractor  is  strange 
As  another  example  consider  a  forced  damped  pendulum  de¬ 
scribed  by  the  equation 

rfJ8/dtJ  +  vM/dt  +  uqsinH  =  fcos(u>t)  (4) 

where  9  is  the  angle  between  the  pendulum  arm  and  the  rest 
position,  v  is  the  coefficient  of  friction.  u>o  is  the  frequency  of  natural 
oscillanon,  and  /  is  the  strength  of  the  forcing.  In  Eq.  4.  the  first 
term  represents  the  inertia  of  the  pendulum,  the  second  term 
represents  friction  at  the  pivot,  the  third  represents  the  gravitational 
fr>rce,  and  the  right  side  represents  an  external  sinusoidally  varying 
torque  of' strength  /'and  frequency  ui  applied  to  the  pendulum  it  the 
pivot.  In  Fig  5a.  we  piot  the  Poincare  surface  of  section  ol  a  strange 
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attractor  for  the  pendulum,  where  we  choose  v  =  0.22,  <oo  =  1.0, 
u  “  !  0,  and  f=  2  7  in  Fq  4  Thn  surface  of  section  is  obtained  by 
plotting  50,000  docs,  one  dot  for  c\cry  cycle  of  the  forcing  term, 
that  is,  one  dot  at  every  time  t  =  /„  =  2 tin  (where  n  is  an  integer). 
The  strange  attractor  shown  in  Fig.  5a  exhibits  a  Cantor  set-like 
structure  transverse  to  the  linear  structure.  This  is  evident  in  Fig.  5b, 
w  hich  shows  an  enlargement  of  the  square  icgion  in  Fig.  5a.  The 
dimension  of  this  strange  attractor  in  the  surface  of  section  is 
^  - 1.38.  Figure  6  shows  the  angular  velocity  dQidi  as  a  function  of  t 
for  the  parameters  of  Fig.  5.  Note  the  apparently  erratic  nature  of 
this  plot. 

In  general,  the  form  of  chaotic  attractors  varies  greatlv  from 
system  to  system  and  even  within  the  same  system.  This  is  indicated 
by  the  sequence  of  chaotic  attractors  shown  in  Fig.  7.  All  of  these 
attractors  were  generated  from  the  same  map  (V), 

i  -  i4i»  iu,  +  cThh.,,80]  mod  1  (51 

6„,i  =  (6„  +  w2  +  tT:(ili„,e„))  mod  1  (6) 

where  /’i  and  /\  are  periodic  with  pci  Kid  one  in  both  their 

arguments.  The  P ,  and  are  the  same  in  all  of  the  cases  shown  in 

fig.  7;  only  the  parameters  wi.  on,  and  t  have  been  varied.  The 
results  show  the  great  variety  c»f  form  and  structure  possible  in 
chaotic  attractors  as  well  as  their  aesthetic  appeal.  Since  0  and  6  may 
be  regarded  as  angles,  Eqs.  5  and  6  are  a  map  on  a  two-dimensional 
toroidal  surface.  (This  map  is  used  in  (9)  to  study  the  transition 
from  quasipcnodicity  to  chaos.  | 

Because  of  the  exponential  divergence  of  nearby  orbits  on  chaotic 
attractors,  there  is  a  question  as  to  how  much  of  the  structure  in 
these  pictures  of  chaotic  attractors  (Figs.  4,  5,  ai  d  7)  is  an  artifact 
due  to  chaos-amplified  roundoff  error.  Although  a  numerical  trajec¬ 
tory  will  diverge  rapidly  from  the  true  trajectory  with  the  same 
inuta!  point,  it  hav  bevn  ticrno/iuraicu  og  irouslv  ' 10 '  in  important 
caves  (including  :1k  ri..io:,  i,.q  »  rbcw  o,jt-  ,  cur 


trajectory  with  a  slightly  different  initial  point  that  stays  near  the 
noisy  trajectory  for  a  long  time.  [For  example,  for  the  Henon  map 
for  a  typical  numerical  trajectory  computed  with  14-digit  precision 
there  exists  a  true  trajectory  that  stays  within  10'1  of  the  numerical 
trajectory  for  107  iterates  ( 1 1 ). |  Thus  we  believe  that  the  apparent!, 
fractal  structure  seen  in  pictures  such  as  Figs.  4,  5,  and  7  is  real 


The  Evolution  of  Chaotic  Attractors 

In  dissipative  dynamics  it  is  common  to  find  that  for  some  value 
of  a  system  parameter  only  a  nonchaotic  attracting  orbit  (a  limit 
cycle,  for  example)  occurs,  whereas  at  some  other  value  of  the 
parameter  a  chaotic  attractor  occurs.  It  is  therefore  natural  to  ask 
how  the  one  comes  about  from  the  other  as  the  system  parameter  is 
varied  continuously.  This  is  a  fundamental  question  that  has  elicited 
a  great  deal  of  attention  (9,  12-19). 

To  understand  the  nature  of  this  question  and  some  of  the 
possible  answers  to  it,  we  consider  Fig.  8a,  the  so-called  bifurcation 
diagram  for  the  map. 

xr„,,  =  C  -xil  (7) 

where  C  is  a  constant.  Figure  8a  can  be  constructed  as  follows:  take 
C  =  -0.4,  set  xu  =  -0.5,  iterate  the  map  100  times  (to  eliminate 
transients),  then  plot  the  next  1 000  values  of x;  increase  C  bv  a  small 
amount,  say  0.001,  and  repeat  what  was  done  for  C  =  -0  4; 
increase  again,  and  repeat;  and  so  on,  until  C  =  2. 1  is  reached.  VVe 
see  from  Fig.  8a  that  below  a  certain  value,  0=0,=  -0.25,  there 
is  no  attractor  in  -2  <  x  <  2.  In  fact,  in  this  ease  all  orbits  go  to 
x  — *  -x,  hence  the  absence  of  points  on  the  plot.  This  is  also  true 
for  C  above  the  “crisis  value”  Cc  =  2.0.  Between  these  two  values 
there  is  an  attractor.  As  C  is  increased  we  have  an  attracting  orbit  o( 
“period  one,"  which,  at  C  =  0.75,  bifurcates  to  a  peruxl-rwi 
attracting  orbit  (x„  -*  xB  -*  x„  -*  xB  -» •  ■  •),  which  then  bifurcates 
(at  C=1.25)  to  a  period-four  orbit  (x.  — >  xb  — >  xc  — *  xj  — 
x,  -*  xb  -♦  xc  -*  xd  — ♦  x,  -»  •  •  •)■  In  fact,  there  arc  an  infinite  num¬ 
ber  of  such  bifurcations  of  period  2''  to  period  2”' 1  orbits,  and  these 
accumulate  as  n  -♦  x  at  a  finite  value  of  C,  which  we  denote  C, 
(from  Fig.  8a,  C,  ts  1.4).  [The  practical  importance  of  this  phe¬ 
nomenology  was  emphasized  early  on  by  May  (/2).] 

What  is  the  situation  for  0.<  C  <  Cc?  Numerically  what  one 
sees  is  that  for  many  C  values  in  this  range  the  orbits  appear  to  be 
chaotic,  whereas  for  others  there  are  periodic  orbits.  For  example. 
Fig.  8b  shows  an  enlargement  of  Fig.  8a  for  C  in  the  range 
1.72  <  C  <  182.  We  sec  what  appear  to  be  chaotic  orbits  below 
C  =  Q,1”  =  1.75.  However,  just  above  this  value,  a  period-three 
orbit  appears,  supplanting  the  chaos.  The  period-three  orbir  then 
goes  through  a  pci  iC>d-doubling  cascade,  becomes  chaotic,  widens 
into  a  three-piece  chaotic  attractor,  and  then  finallv  at 
C  =  Q°!  a  1.79  widens  back  into  a  single  chaotic  band.  We  tall 
the  region  Co1”  <  C  <  Ccn>  a  period-three  window.  ;Such  win¬ 
dows,  but  of  higher  period,  appear  throughout  the  region  Cx 
<  C  •"  Cc.  but  are  not  as  discernible  in  Fig.  8a  because  thev  arc 
much  nairower  than  the  period-three  window.) 

An  infinite  period-doubling  cascade  is  one  way  that  a  chaotic 
attractor  can  come  about  from  a  nonchaotic  one  (13).  There  are  also 
two  other  possible  >outcs  to  chaos  exemplified  in  Fig.  8,  a  and  b. 
These  are  the  intermirtcncy  route  (14)  and  the  crisis  route  (15). 

Intcrmitttncy.  Consider  Fig.  8b.  For  C  just  above  C#1*1  there  is  a 
period-three  orbit.  For  C  just  below  Co*1  there  appears  to  be  \ 
chaotic  orbit  To  understand  the  character  of  this  transition  it 
useful  io  examine  the  chaouc  orbit  for  C  just  below  Co71.  The 
cbjrjrtcr  of  this  nibi'  ,g  as  follows  The  orbit  appears  to  be  a  period- 
1  rre  orh  i  t-v  I.  societies  of  i  .,t:  after  which  thtre  is  a  short 
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Fig.  7.  Sequence  of  Uuoc- 
ic  attractors  for  system 
represented  by  Eqs  5  and 
A  Plot  shows  iterated 
r'~  mapping  on  a  torus  for 
V  different  values  of  w,,  u <5, 
and  t.  (Topi  uii  =  0.54637, 
C. 36736,  and  t  = 
0.75.  (Corrtor)  u>, 
045922,  uh  =  0.53968, 
and  t  -=  0.50.  (Bottom) 
u>i  »  0.41500,  ui?  = 
0.73500,  and  <  =  0.60 
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burst  (the  ‘intermittent  burst”)  of  chloric  like  behavior,  followed  by 
.mother  long  stretch  of  almost  period- three  behavior,  followed  by  a 
chaotic  burst,  and  so  on  As  approaches  C'„'”  frtim  below,  the 
average  duration  of  the  long  stretches  between  the  intermittent 
bursts  becomes  longer  and  longer  1 14).  approaching  infinity  and 
proportional  to  (C»  -  C)  " in  as  -•  Co1'1  Tims  the  pure  period- 

three  orbit  appears  at  C  =  Co1*1.  Alternatively  we  mav  sav  that  the 
attracting  pc'iodic  attractor  of  period  three  is  converted  to  a  chaotic 
attractor  as  the  parameter  C  decreases  through  the  critical  value 
CV”  It  should  be  emphasized  that,  although  our  illustration  of  the 
transition  to  chaos  by  way  of  nterrnirten<  v  is  « ithtn  the  context  of 
the  period-three  window  of  the  quadratic  map  given  by  Eq  7,  this 
phenomenon  (as  well  as  period-doubling  cascades  and  crises)  ts  verv 
general,  in  other  systems  it  occurs  tor  other  periods  (period  one.  for 
example)  in  easily  observable  form 
Cm  a  From  Fig.  8a  we  see  mat  there  is  a  chaotic  attractor  for 
C  <  C\.  ~  2.  hut  no  chaotic  attractor  for  C,  ■  C,.  Fluis,  as  (.'  is 
'  awered  through  Ce,  a  chaotic  attractor  is  born.  I  low  docs  this 
occur?  Note  that  at  C.  =  Cc  the  chaotic  orbit  occupies  the  interval 
-  2  s  x  s  2  If  C  is  just  slightly  larger  than  an  orbit  with  initial 
condition  in  the  'oterv  I  -  2  <  .•■  "  7  will  npicr'K-  tollmv  a  chiotic- 
■  <cc  path  to,  .  nr.  :  -1C.  aher  which  .r  rind'  its  wav  out  of  the 


interval  -2  s*  &  2,  and  then  rapidly  begins  to  move  to  large 
negative  x  values  (that  is,  it  begins  to  approach  x  -  — *).  This  is 
called  a  chaotic  transient  (15).  The  length  of  a  chaotic  transient  will 
depend  on  the  particular  initial  condition  chosen.  One  can  define  a 
mean  transient  duration  by  averaging  over,  for  example,  a  uniform 
distribution  01  initial  conditions  in  the  interval  -2  <  x  <  2.  For  the 
quadratic  map,  this  average  duration  is 

T-l/fC-Cc)1  (8, 

with  the  exponent  y  given  by  y  =  1/2.  Thus  as  C  approaches  Q 
from  above,  the  lifetime  of  a  chaotic  transient  goes  to  infinity  and 
die  transient  is  converted  to  a  chaotic  attractor  for  C  <  Cc  Again, 
diis  type  of  phenomenon  occurs  widely  in  chaotic  systems.  For 
example,  the  model  of  Lorenz  (2)  for  the  nonlinear  evolution  of  the 
Rayleigh- Bcr.ard  instability  of  a  fluid  subjected  to  gravity  and 
heared  from  below  has  a  chaotic  onset  of  the  crisis  type  and  an 
accompanying  chaotic  transient.  In  that  case,  y  in  Eq.  8  is  y  —  4 
•20).  In  addition,  a  theory  for  determining  the  exponent  y  for  rwo- 
dimensional  maps  and  systems  such  as  the  forced  damped  pendulum 
has  recently  been  published  (21).  Thus  we  have  seen  that  the  period 
doubling,  intcrmittency,  and  crisis  routes  to  chaos  are  illustrated  bv 
the  simple  quadratic  map  (Eq.  7). 

We  emphasize  that,  although  a  map  was  used  for  illustrating  tfv  sc 
routes,  all  of  these  phenomena  are  present  in  continuous-time 
systems  and  have  been  observed  in  experiments  As  an  example  of 
chaotic  transitions  in  a  continuous  time  system,  we  consider  the  set 
of  three  autonomous  ordinary  differential  equations  studied  bv 
Lorenz  \2  as  a  model  of  the  Rayleigh-  Benard  instability  , 


ixldt  =  T  v  -  Px 

(9) 

dyidt  =  ~xz  +  rx  -  y 

(10) 

dz-Jt  -  xy  -  bz 

(11) 

where  P  and  b  arc  adjustable  parameters.  Fixing  P  =  10  and  b  =  8/3 
and  varying  the  remaining  parameter,  r.  we  obtain  numerical 
solutions  that  arc  clear  examples  of  the  intcrmittency  and  crisis  types 
of  chaotic  transitions  discussed  above.  We  illustrate  these  in  Fig.  9,  a 
through  d;  the  behavior  of  this  system  is  as  follows: 

1)  For  r  between  166.0  and  166.2  there  is  an  intcrmittencv 
transition  from  a  periodic  attractor  (r  =  166.0,  Fig.  9a)  to  a  chaotic 
attractor  (r  =  166.2.  Fig.  9b)  with  intermittent  turbulent  bursts 
Between  the  bursts  there  arc  long  stretches  of  time  for  which  the 
orbit  oscillates  in  nearly  die  some  way  as  for  the  periodic  attractor 
(14)  (Fig.  9a). 

2)  For  a  range  of  rvalues  below  r  =  24.06  there  arc  two  periodic 
attrjcrors,  tfut  represent  clockwise  and  counterclockwise  convec¬ 
tions.  For  r  slightly  above  24  06,  however,  there  are  three  attractors, 
one  that  is  chaotic  (shown  in  the  phase  space  traiectorv  in  Fig.  9c, 
whereas  the  other  two  attractors  arc  the  previously  mentioned 
periodic  attractors.  The  chaotic  attractor  comes  into  existence  as  r 
increases  through  r  =  24  06  by  conversion  of  a  chaotic  transient 
Figure  9d  shows  an  orbit  in  phase  space  executing  a  chaotic 
transient  before  settling  down  to  its  final  resting  place  at  one  of  the 
periodic  attractors.  Note  the  similarity  of  the  chaotic  transient 
trajectory  in  Fig.  9d  with  the  chaotic  trajectory  in  Fig.  9c 

The  various  routes  to  chaos  have  also  received  exhaustive  experi¬ 
mental  support.  For  instance,  period-doubling  cascades  have  been 
observed  in  the  Raylctgh-Bctiard  convection  (22.  23 ),  in  nonlinear 
circuits  (24).  and  in  lasers  (25 1,  intcrmittency  has  been  observed  in 
the  Rayleigh- Bernard  convection  (20)  and  in  the  Belousov- Ziubo- 
tinsky  reaction  (27);  and  crises  have  been  observed  in  nonlinear 
circuits  (2S-30),  in  the  Joscptison  junction  (31).  and  in  lasers  (32). 

Finally,  we  note  that  period  doubling,  intcmiittenev,  and  crises 
do  not  exhaust  the  possible  list  of  routes  to  chaos.  (Indeed,  the 
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routes  arc  not  all  known.)  In  particular,  chaotic  onsets  involving 
quasipcriodicity  have  not  been  discussed  here  (9,  16,  18) 


Universality 

Universality  refers  to  the  fact  that  systems  behave  in  certain 
quantitative  ways  that  depend  not  on  the  detailed  physics  or  model 
description  but  rather  only  on  some  general  properties  of  the 
svstem.  Universality  has  been  examined  by  renormalization  group 
i33)  techniques  developed  for  the  study  of  critical  phenomena  in 
condensed  matter  physics.  In  the  context  of  dvnamics,  Fcigenbaum 
(13)  was  the  first  to  apply  these  ideas,  and  he  has  extensively 
developed  them,  particularly  for  period  doubling  for  dissipative 
svstems.  (See  (17)  for  a  collection  of  papers  on  universality  in 
nonlinear  dynamics.]  Toi  period  doubling  in  dissipative  systems, 
results  have  been  obtained  on  the  scaling  behavior  of  power  spectra 
for  time  scries  of  the  dynamical  process  (34),  on  the  effect  of  noise 
on  period  doubling  (35),  and  on  the  dependence  of  the  Lvapunov 
exponent  (36)  on  a  system  parameter.  Applications  of  the  renormali¬ 
zation  group  have  also  been  made  to  interrrattency  '19, 37),  and  the 
breakdown  of  quasipcriodicity  in  dissipative  !  18)  and  consetvauve 
(38)  systems. 

As  examples,  two  “universal”  results  can  be  stated  within  the 
context  of  the  bifurcation  diagrams  (Fig.  8,  a  and  b).  Let  C„  denote 
the  value  of  C  at  which  a  period  2“  evde  period  doubles  to  become  a 
period  2" 1  cycle.  Then,  for  the  bifurcation  diagram  in  Fig.  8a,  one 
obtains 

l'~.  —~r  =  4  669201  .  .  (12) 

i  - 

The  result  given  in  Eq.  1 2  is  not  restricted  to  the  quadratic  map.  In 
fact,  it  applies  to  a  broad  class  of  systems  that  undergo  period 
doubling  cascades  (13,  39).  In  practice  such  cascades  are  very 
common,  and  the  associated  universal  numbers  are  observed  to  be 
well  approximated  by  means  ot  fa>r|v  low  order  bifurcations  (for 
example,  n  -  2.3,4).  This  scaling  behavior  has  ben,  observed  in 


manv  experiments,  including  ones  on  fluids,  nonlinear  circuits,  laser 
svstems,  and  so  forth.  Although  universality  arguments  do  not 
explain  whv  cascades  must  exist,  such  explanations  arc  available  frtwn 
bifurcation  theory  (40). 

Figure  8b  shows  the  period-three  window  within  the  chaotic 
range  of  the  quadratic  map.  As  already  mentioned,  there  arc  an 
infinite  number  of  such  periodic  windows.  (In  fact,  they  are 
generally  believed  to  be  dense  in  the  chaotic  range.  For  example,  if  * 
is  prime,  there  arc  (2*  -  2)/(2k)  period-*  windows  ]  Let  Co'11  and 
Cc'*'  denote  the  upper  and  losver  values  of  C  bounding  the  period-* 
window  and  let  CdUl  denote  the  value  of  C  at  which  the  period-* 
attractor  bifurcates  to  period  2*.  Then  we  have  that,  for  typical  * 
window's  (41). 


Iim 

A-* 


f'  (A)  _  <*> 

c;*’  -  Co“' 


9/4 


(13) 


In  fan,  even  for  the  *  =  3  window  (Fig.  8b)  the  9/4  value  is  closely 
approximated  (it  is  9/4  -  0.074  .  .  .).  This  result  is  universal  for 
one-dimensional  maps  (and  possibly  more  generally  for  any  chaotic 
dynamical  process)  with  windows. 


Fractal  Basin  Boundaries 

In  addition  to  chaotic  attractors,  there  can  be  sets  in  phase  space 
on  which  orbits  are  chaotic  but  for  which  points  near  the  set  move 
away  from  the  set.  That  is,  they  are  repelled.  Nevertheless,  such 
chaotic  repellcrs  can  still  have  important  macroscopically  observable 
effects,  and  wc  consider  one  such  effect  (42,  43)  in  this  section. 

Typical  nonlinear  dynamical  systems  may  have  more  than  one 
ume-asymptotic  final  state  (attractor),  and  it  is  important  to  consid¬ 
er  the  extent  to  which  uncertainty  in  initial  conditions  leads  to 
uncertainty  in  the  final  state.  Consider  the  simple  two-dimensional 
phase  space  diagram  schematically  depicted  in  Fig.  10.  There  arc 
two  attractors  denoted  A  and  B.  Initial  conditions  on  one  side  of  the 
boundary,  I,  eventually  asymptotically  approach  B;  those  on  the 
other  side  of  £  eventually  go  to  A.  The  region  to  the  left  or  right  of 
S  is  the  basin  of  attraction  for  attractor  A  or  B,  respectively,  and  I  is 
the  basin  boundary.  If  the  initial  conditions  arc  uncertain  by  an 
amount  (.  then  for  those  initial  conditions  within  t  of  the  boundary 
w-c  cannot  sav  a  priori  to  which  attractor  the  orbit  eventually  rends. 


a  b 
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Fig,  9.  Intcrminenci  triais,  and  period  doubling  in  continuous  time 
lysicms.  Imermittcncy  in  the  Lorenz  equ.-.iiora  (•)  r  -  166.0;  (b) 
r  -  I6n.2  ('run  transition  in  a  iliaobc  attractor  ui  ti  c  Ixxicnz  equations 
(Cl  .  -  Z&,  (d>  r  *  22 
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Fig.  10.  A  region  ot  phase  space  divided  b,  T  ,  f . 

the  basin  boundary  £  into  basins  ot  attraction 
tor  the  two  attractors  A  and  B  Points  1  and  2 
arc  initial  conditions  with  error  «. 


For  example,  in  Fig.  10,  points  1  and  2  arc  initial  conditions  with  an 
uncertainty  t.  The  orbit  generated  by  initial  condition  1  is  attracted 
to  attractor  B.  Initial  condition  2,  however,  is  uncertain  in  the  sense 
that  the  orbit  generated  by  2  may  be  attracted  either  to  A  or  B.  In 
particular,  consider  the  frac  tion  of  the  uncertain  phase  space  volume 
within  the  rectangle  shown  and  denote  this  fraction  /  For  the  case 
shown  in  Fig.  10,  we  clearly  have/~  t.  The  main  point  we  wish  to 
make  in  what  follows  is  that,  from  the  point  of  view  of  prediction, 
much  worse  scalings  of  /  with  *  frequently  occur  in  nonlinear 
dynamics.  Namely,  the  fraction  can  scale  as 

f- «*  (14) 

with  the  “uncertainty  exponent^'  a  satisfying  a  <  1  (42,  43).  In  fact, 
a  *,<  1  is  fairlv  common.  In  such  a  case,  a  substantial  reduction  in 
the  initial  condition  uncertainty,  t,  yields  only  a  relatively  small 
decrease  in  the  uncertainty  of  the  final  state  as  measured  by  / 

Although  a  is  equal  to  unity  for  simple  basin  boundaries,  such  as 
mat  depicted  in  F'g  10,  boundaries  with  noninteger  (fractal) 
dimension  also  occur.  W’c  use  here  the  capacity  definition  of 
dimension,  Eq.  1.  In  general,  since  the  basin  boundary  divides  the 
phase  space,  its  dimension  d  must  satisfy  d  2  D  -  1 ,  where  D  is  the 
dimension  of  the  phase  space  It  can  be  proven  that  the  following 
relation  between  the  index  a  and  the  basin  boundary  dimension 
holds  42.  43) 

a  =  D  -  d  (15) 

For  a  simple  boundary,  such  as  rhat  depicted  in  Fig.  10,  we  have 
d  -  D  -  1.  and  Eq  IS  then  gives  a  =  1,  as  expected.  For  a  fractal 
basin  boundary,  d  >  D  -  1,  and  Eq.  15  gives  a  <  1. 

We  now  illustrate  the  abuse  with  a  concrete  example.  Consider 
the  forced  damped  pendulum  as  given  by  Eq.  4.  For  parameter 
salues  v  =  0.2,  ton  =  1  0,  iu  =  1.0,  and  J  =  2.0,  we  find  numerically 
mat  the  only  attractors  in  the  surface  of  section  (8,  dBidi)  are  the 
fixed  points  (-0  477,  -0.609)  and  (-0  471,  2.037).  They  repre- 
s-.nr  solutions  with  average  counterclocku  isc  and  clockwise  rotation 
at  the  period  of  the  forcing  The  eoscr  shows  a  computer-generated 
picture  of  the  basins  of  attraction  for  the  two  fixed  point  attractors. 
Each  initial  condition  m  a  1024  bv  1024  point  grid  is  integrated 
until  it  is  close  to  one  of  the  two  attractors  (typically  100  cycles).  If 
an  orbit  goes  to  the  attractor  at  9  -  -0  477,  a  blue  dot  is  plotted  at 
the  corresponding  initial  condition.  If  the  orbit  goes  to  the  other 
lrtraccor.  a  red  dot  is  plotted.  Thus  the  blue  and  red  regions  are 
essentially  pictures  of  the  basins  of  attraction  tor  the  two  attractors 
to  the  accuracy  of  the  grid  ot  rhe  computer  plotter.  Fine-scale 
structure  in  the  basins  of  attraction  is  evident.  This  is  a  consequence 
ot  the  Cantor-set  nature  of  the  basin  boundary.  In  fact,  magnifica¬ 
tions  of  the  basin  boundary  show  that,  as  we  examine  it  on  a  smaller 
and  smaller  scale,  it  continues  to  have  structure. 

We  now  w  ish  to  explore  the  consequences  for  prediction  of  this 
infinitely  fine  . scaled  structure.  To  do  this,  consider  an  initial 
condition  (H,  dttldt).  What  is  the  effect  of  a  small  change  t  in  the  B- 
coordinate’  Thus  we  integrate  the  forced  pendulum  equation  with 
ihe  initial  conditions  (8.  dildt),  f«,  dftidt  +  «),  and  (8,  itydt  -  *) 
•uitil  they  approach  one  of  the  attractors  If  either  or  both  of  the 
^rrurbed  initial  conditions  yield  orbits  that  do  not  approach  the 
same  attractor  as  the  unperturbed  initial  condition,  we  say  that  (8. 
dH'dt)  is  uncertain  Now  we  randnmh  choose  a  large  number  of 
initial  conditions  and  I -  t  *'  dent  re  the  fraction  o'  these  that  eve  find 


to  be  uncertain.  As  a  result  of  these-  calculations,  we  rind  that  /  - 
w  here  n  s.  0.275  -  0  005  If  we  assume  that  /,  determined  in  the 
way  stated  above,  is  approximately  proportional  to  /[there  is  some 
support  for  this  conjecture  from  theoretical  work  144)},  then  a  =  a. 
Thus,  from  Eq.  15,  the  dimension  of  the  basin  boundary  is 
d  a  1.725  ±  0.005.  We  conclude,  from  Eq.  14,  that  in  this  case  if 
we  are  to  gain  a  factor  of  2  in  the  ability  to  predict  the  asymptotic 
final  state  of  the  system,  it  is  necessary  to  increase  the  accuracy  in  the 
measurement  of  the  initial  conditions  by  a  factor  substantially 
greater  than  2  (namely  by  2“’ :7f  s  10).  Hence,  fractal  basin 
boundaries  (a  <  1)  represent  an  obstruction  to  predictability  in 
nonlinear  dynamics. 

Some  representative  works  on  fractal  basin  boundaries,  including 
applications,  are  listed  in  (42^t7).  Notable  basic  questions  that  have 
recently  been  answered  are  the  following: 

1 )  How  does  a  nonfractal  basin  boundary  become  a  fractal  basin 
boundary  as  a  parameter  of  the  system  is  varied  (45)?  This  question 
is  similar,  in  spirit,  to  the  question  of  how  chaotic  attractors  come 
about. 

2)  Can  fractal  basin  boundaries  have  different  dimension  values  in 
different  regions  of  the  boundary,  and  what  boundary  structures 
lead  to  this  situation?  This  question  is  addressed  in  (46)  where  it  is 
shown  that  regions  of  different  dimension  can  be  intertwined  on  an 
arbitrarily  fine  scale. 

3)  What  arc  the  effects  of  a  fractal  basin  boundary  when  the 
svstem  is  subject  to  noise?  This  has  been  addressed  in  the  losephson 
junction  experiments  of  (31). 


Conclusion 

Chaotic  nonlinear  dynamics  is  a  vigorous,  rapidlv  expanding  field 
Many  important  future  applications  are  to  be  expected  in  j  variety  ot 
areas.  In  addition  to  its  practical  aspects,  the  field  also  has  funda¬ 
mental  implications.  According  to  Laplace,  determination  of  the 
future  depends  only  on  the  present  state.  Chaos  adds  a  basic  new 
aspect  to  this  rule:  small  errors  in  our  knowledge  can  grow 
exponentially  with  time,  thus  making  the  long-term  prediction  of 
the  future  impossible 

Although  the  held  has  advanced  at  a  great  rate  in  recent  years, 
there  is  still  a  wealth  of  challenging  fundamental  questions  that  hav  e 
vet  to  be  adequately  dealt  with.  For  example,  most  concepts 
developed  so  far  have  been  discovered  in  what  are  effectively  low- 
dimensional  systems,  what  undiscovered  important  phenomena  will 
appear  only  in  higher  dimensions?  Why  arc  transiently  chaotic 
motions  so  prevalent  in  higher  dimensions?  In  what  ways  is  it 
possible  to  use  the  dimension  of  a  chaotic  attractor  to  determine  the 
dimension  of  the  phase  space  necessary  to  describe  the  dynamics? 
Can  renormalization  group  techniques  be  extended  past  the  border¬ 
line  of  chaos  into  the  strongly  chaotic  regime’  These  arc  only  a  few 
questions.  There  arc  many  more,  and  probably  the  most  important 
questions  are  those  that  have  not  yet  been  asked. 
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cover  Even  systems  as  simple  as  a  periodically  forced  damped  pendulum  can 
have  complex  behavior.  This  computer-generated  plot  shows  initial  pendulum 
velocities  (measured  horizontally)  and  positions  (measured  vertically).  Orbits 
starting  at  points  in  the  red  region  cvcnrually  settle  into  one  type  of  periodic  motion, 
while  orbits  starring  in  the  blue  region  yield  a  different  rvpc  of  periodic  morion.  The 
boundary  between  these  regions  is  fractal.  The  lighter  the  shade  of  red  or  blue,  the 
longer  it  takes  to  settle  into  the  corresponding  motion.  Sec  page  632.  (Photo 
courtesy  of  C.  Grebogi,  E.  Ott,  and  J.  A.  Yorke,  University  of  Maryland,  College 
Park,  MD  20742J 
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Appendix  5: 


"A  Better  Way  to  Compress  Images",  Michael  Barnsley 
and  Alan  Sloan,  BYTE,  January  1988. 


Reprinted  with  permission. 
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A  Better  Way  to 
Compress  Images 

Mathematics  is  providing  a  novel  technique  for  achieving 
compression  ratios  of  10,000  to  1—and  higher 


Michael  F.  Barnsley  and  Alan  D.  Sloan 


THE  NATURAL  WORLD  is  filled  with 
intricate  detail.  Consider  the  geometry 
on  the  back  of  your  hand:  the  pores,  the 
fine  lines,  and  the  color  variations.  A 
camera  can  capture  that  detail  and,  at 
your  leisure,  you  can  study  the  photo  to 
see  things  you  never  noticed  before.  Can 
personal  computers  be  made  to  carry  out 
similar  functions  of  image  storage  and 
analysis?  If  so,  then  image  compression 
will  certainly  play  a  central  role. 

The  reason  is  that  digitized  images— 
images  converted  into  bits  for  processing 
by  a  computer — demand  large  amounts  of 
computer  memory.  For  example,  a  high- 
detail  gray-scale  aerial  photograph  might 
be  blown  up  to  a  3  'h  -foot  square  and  then 
resolved  to  300  by  300  pixels  per  square 
inch  with  8  significant  bits  per  pixel. 
Digitization  at  this  level  requires  130 
megabytes  of  computer  memory— too 
much  for  personal  computers  to  handle. 

For  real-world  images  such  as  the  aeri¬ 
al  photo,  current  compression  techniques 
can  achieve  ratios  of  between  2  to  1  and 
10  to  1.  By  these  methods,  our  photo 
would  still  require  between  65  and  13 
megabytes. 

In  this  article,  we  describe  some  of  the 
main  ideas  behind  a  new  method  for 
image  compression  using  fractals.  The 
method  has  yielded  compression  ratios  in 
excess  of  10,000  to  1  (bringing  our  aerial 
photo  down  to  a  manageable  13,000 
bytes).  The  color  pictures  in  figures  I 
through  5  were  encoded  using  foe  new 
technique;  actual  storage  requirements 
for  these  images  range  from  100  to  2000 
bytes. 

A  mathematics  research  team  at  foe 


Georgia  Institute  of  Technology  is  devel¬ 
oping  foe  system,  with  funding  provided 
by  the  Defense  Advanced  Research  Proj¬ 
ects  Agency  (DARPA)  and  the  Georgia 
Tech  Research  Corporation  (GTRC).  Our 
description  is  necessarily  simplified,  but 
it  will  show  you  how  a  fractal  image- 
compression  scheme  operates  and  how  to 
use  it  to  create  exciting  images. 

Describing  Natural  Objects 
Traditional  computer  graphics  encodes 
images  in  terms  of  simple  geometrical 
shapes:  points,  line  segments,  boxes,  cir¬ 
cles,  and  so  on.  More  advanceo  systems 
use  three-dimensional  elements,  such  as 
spheres  and  cubes,  and  add  color  and 
shading  to  the  description. 

Graphics  systems  founded  on  tradi¬ 
tional  geometry  are  great  for  creating  pic¬ 
tures  of  man-made  objects,  such  as 
bricks,  wheels,  roads,  buildings,  and 
cogs.  However,  they  don’t  work  well  at 
all  when  foe  problem  is  to  encode  a  sun¬ 
set,  a  tree,  a  lump  of  mud,  or  foe  intricate 
structure  of  a  black  spleenwort  fern. 
Think  about  using  a  standard  graphics 
system  to  encode  a  digitized  picture  of  a 
cloud:  You’d  have  to  tell  foe  computer  foe 
address  and  color  attribute  of  each  point 
in  the  cloud.  But  that’s  exactly  what  an 
uncompressed  digitized  image  is— a  long 
list  of  addresses  and  attributes. 

To  escape  this  difficulty,  we  need  a 
richer  library  of  geometrical  shapes. 
These  shapes  need  to  be  flexible  and  con¬ 
trollable  so  that  they  can  be  made  to  con¬ 
form  to  clouds,  mosses,  feathers,  leaves, 
and  faces,  not  to  mention  waving  sun¬ 
flowers  and  glaring  arctic  wolves.  Fractal 


geometry  provides  just  such  a  collection 
of  shapes.  For  a  hint  of  this,  glance  at  foe 
pictures  in  The  Fractal  Geometry  of  Na¬ 
ture  by  Benoit  Mandelbrot,  who  coined 
the  term  fractal  to  describe  objects  that 
are  very  “fractured”  (see  references  for 
additional  books  and  articles).  Some  ele¬ 
mentary  fractal  images  accompany  this 
article. 

Using  fractals  to  simulate  landscapes 
and  other  natural  effects  is  not  new;  it  has 
been  a  primary  practical  application.  For 
instance,  through  experimentation,  you 
find  that  a  certain  fractal  generates  a  pat¬ 
tern  similar  to  tree  bark.  Later,  when  you 
want  to  render  a  tree,  you  put  foe  tree- 
bark  fractal  to  work. 

What  is  new  is  foe  ability  to  start  with 
an  actual  image  and  find  foe  fractals  that 
will  imitate  it  to  any  desired  degree  of  ac¬ 
curacy.  Since  our  method  includes  a  com¬ 
pact  way  of  representing  these  fractals, 
we  end  up  with  a  highly  compressed  data 
set  for  reconstructing  foe  original  image. 

Overview  of  Fractal  Compression 
We  start  with  a  digitized  image.  Using 
image-processing  techniques  such  as 
color  separation,  edge  detection,  spec¬ 
trum  analysis,  and  texture-variation 
analysis,  we  break  up  foe  image  into  seg¬ 
ments.  (Some  of  the  same  techniques 

continued 
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three-dimensional fems  (4 
transformations ,  100  bytes). 


figure  2:  IFS-encoded  color  photo  of 
Black  Forest,  color  set  adjusted  to  give 
winter  tones  (120  transformations, 
2000  bytes). 


i 


Figure  3:  IFS-encoded  color  photo  of  a 
Bolivian  girl  (120  transformations,  2000 
bytes). 


form  the  basis  for  the  automatic  coloring 
of  black-and-white  motion  pictures.)  A 
segment  might  be  a  fern,  a  leaf,  a  cloud, 
or  a  fence  post.  A  segment  can  also  be  a 
more  complex  collection  of  pixels:  A  sea¬ 
scape,  for  example,  may  include  spray, 
rock,  and  mist. 

We  then  look  up  these  segments  in  a  li¬ 
brary  of  fractals.  The  library  doesn’t 
contain  literal  fractals;  that  would  require 
astronomical  amounts  of  storage.  In¬ 
stead,  our  library  contains  relatively 
compact  sets  of  numbers,  called  derated 
function  system  (IFS)  codes,  that  will  re¬ 
produce  the  corresponding  fractals.  Fur¬ 
thermore,  the  library's  cataloging  system 
is  such  that  images  that  look  alike  are 
close  together:  Nearby  codes  correspond 
to  nearby  fractals.  This  makes  it  feasible 
to  set  up  automated  procedures  for 
searching  the  library  to  find  fractals  that 
approximate  a  given  target  image.  A 
mathematical  result  known  as  the  Collage 
Theorem  (more  on  that  later)  guarantees 
that  we  can  always  find  a  suitable  IFS 
code— and  gives  a  method  for  doing  so. 

Once  we  have  looked  up  all  the  seg¬ 
ments  in  our  library  and  found  their  IFS 
codes,  we  can  throw  away  the  original 
digitized  image  and  keep  the  codes, 
achieving  our  compression  ratio  of 
10,000  to  I— or  even  higher. 

Iterated  Function  Systems 

We  start  by  explaining  how  a  set  of  IFS 

codes  can  approximate  a  natural  image. 

IFS  theory  is  an  extension  of  classical 
geometry.  It  uses  affine  transformations, 
explained  below,  to  express  relations  be¬ 
tween  parts  of  an  image.  Using  only  these 
relations,  it  defines  and  conveys  intricate 
pictures.  With  IFS  theory,  we  can  de¬ 
scribe  a  cloud  as  clearly  as  an  architect 
can  describe  a  house. 

By  studying  the  following  sections. 


Figure  4:  IFS-encoded  color  photo  of 
the  Monterey  coast  (60  transformations, 
100  bytes). 


you  should  be  able  to  encode  and  decode 
fascinating  black-and-white  image  seg¬ 
ments,  such  as  leaf  skeletons,  tree 
shadows,  spirals,  and  thunderheads.  You 
should  also  obtain  an  overview  of  how  a 
fully  automated  fractal  compression  sys¬ 
tem  operates. 

Affine  transformations  can  be  de¬ 
scribed  as  combinations  of  rotations, 
scalings,  and  translations  of  the  coordi¬ 
nate  axes  in  n-dimensional  space.  An  ex¬ 
ample  in  two  dimensions  is 

W(x,y)  =  (Vix+  Wy+ 1 .  Wjt+'/iy+2), 

which  can  also  be  written  in  matrix  form 
as 


This  transformation  moves  the  point  (0,0) 
to  (1,2)  and  moves  (-1,0.5)  to  (0.625, 
2).  To  confirm  your  understanding  of  the 
idea,  you  should  work  out  where  it  moves 
the  point  (1.1).  We  denote  this  transfor¬ 
mation  by  H/;  the  notation  denotes 
the  subimage  of  Ik' on  a  set  of  points  S. 

Now  let’s  see  what  Ik’ does  to  a  picture 
of  a  smiling  face,  F.  lying  on  the  x.y  plane 
(see  figure  6).  The  result  is  a  new. 
squeezed  face  W(F).  The  affine  transfor¬ 
mation  has  deformed  and  moved  the  face. 
Notice  that  the  eyes  in  the  transformed 
face  W(F)  are  closer  together  than  they 
are  in  F.  We  say  that  the  transformation  W 
is  contractive:  It  always  moves  points 
closer  together. 

Another  example  of  a  contractive  af¬ 
fine  transformation  is  shown  in  figure  7. 
This  time  it  acts  on  a  leaf  to  produce  a 
new,  smaller  leaf. 

The  general  form  for  an  affine  trans¬ 
formation  is 


Figure  5:  IFS-encoded  color  image 
from  A  Cloud  Study  (30 
transformations,  500  bytes). 
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where  the  coefficients  a,  b,  c,  d,  e,  and / 
are  real  numbers. 

If  we  know  in  advance  the  translations, 
rotations,  and  scalings  that  combine  to 
produce  W ,  we  can  generate  coefficient 
values  as  follows. 

a  =  rcosS.  b  *  -ssin^, 
c  =  rsintf.d  =  .s  cos  <p, 

w  here  r  is  the  scaling  factor  on  x,  s  is  the 
scaling  factor  on  v,  6  is  the  angle  of  rota¬ 
tion  on  x,  0  is  the  angle  of  rotation  on  y.  c 
is  the  translation  on  x,  and  /  is  the  transla¬ 
tion  on  v. 

How  can  you  find  an  affine  transfor¬ 
mation  that  produces  a  desired  effect? 
Let's  show  how  to  find  the  affine  trans¬ 
formation  that  takes  the  big  leaf  to  the  lit¬ 
tle  leaf  in  figure  7.  We  wish  to  find  the 
numbers  a.b.c,  d,  e,  and / for  which  the 
transformation  It' has  the  property 

W(bigleaf)  •  little  leaf. 

Begin  by  introducing  x  and  y  coordinate 
axes,  as  already  shown  in  the  figure. 
Mark  three  points  on  the  big  leaf  (we’ve 
chosen  the  leaf  tip,  a  side  spike,  and  the 
point  where  the  stem  joins  the  leaf)  and 
determine  their  coordinates  (a,. a,), 
(3,.0 1),  and  (y,,y,).  Mark  the  corre¬ 
sponding  points  on  the  little  leaf  and 
determine  their  coordinates  (a,, a,), 
<3,,8i).  and  (>,,>,),  respectively. 

Determine  values  for  the  coefficients 
a,  b,  and  e  by  solving  the  throe  linear 
equations 


or,  a  +  a,b  +  e  =  or,  .  (1) 

0,  a  +  0,b  +  e  =  0, ,  (2) 

y,a  +  y,b  +  e  =  y,  ,  (3) 

and  find  c,  d,  and  /  in  similar  fashion 

from  these  equations: 

or,  c  +  aid  +/=  oti .  (4) 

0i  c  +  0i  d  +/«  0i ,  (5) 

hC  +  ytd  +/*yj .  (6) 

We  recommend  the  use  of  an  equation 
solver  such  as  TK  Solver  Plus  (Universal 
Technical  Systems,  Rockford,  Illinois)  or 
Eureka  (Borland  International,  Scotts 
Valley,  California)  for  finding  the  coeffi¬ 
cient  values.  Doing  it  manually  can  be 
tedious. 

Now  that  we  know  what  a  contractive 
continued 


Figure  6:  An  affine  transformation  W 
moves  the  smiling  face  T  to  a  new  face 
W(F).  The  transformation  is  called 
contractive  because  it  moves  points 
closer  together. 


Table  1:  IFS  codes  fora  Sierpihski  mangle. 


w 

• 

b 

C 

d 

• 

f 

P 

1 

05 

0 

0 

0.5 

0 

0 

0.33 

2 

05 

0 

0 

0.5 

1 

0 

0  33 

3 

05 

0 

0 

0.5 

05 

05 

0.34 

Table  2:  IFS  codes  for  a  square. 


W 

a 

b 

C 

d 

• 

f 

P 

1 

05 

0 

0 

05 

KtK 

0 

0.25 

2 

05 

0 

0 

0.5 

0  5 

0 

0.25 

3 

05 

0 

0 

05 

0 

05 

0  25 

4 

05 

0 

0 

05 

05 

05 

025 

Table  3:  IFS  codes  fora  fern. 


W 

• 

b 

C 

d 

• 

f 

P 

0 

0 

0 

0.16 

0 

0 

0  01 

0.2 

-0.26 

0.23 

0  22 

0 

16 

007 

-0.15 

0.28 

026 

C  24 

0 

0  44 

007 

085 

0.04 

-0  04 

0  85 

0 

16 

0  85 

Table  4:  IFS  codes  for  fractal  tree. 


W 

1 

b 

c 

d 

• 

p 

0 

0 

0 

05 

n 

n 

005 

0  1 

0 

0 

0  1 

Kfl 

0.15 

0  42 

-0.42 

042 

0  42 

Bl 

MTu 

EZB 

0.42 

042 

-0  42 

042 

n 

ia 

ixfl 
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affine  transiormation  is  and  how  to  find 
one  that  maps  a  source  image  onto  a  de¬ 
sired  target  image,  we  can  describe  an 
iterated  function  system.  An  IFS  is  a  col¬ 
lection  of  contractive  affine  transforma¬ 
tions.  Here's  an  example  of  an  IFS  of 
three  transformations: 


w  M  ro.5  o.o 

LvJ  L° 0  05 

«■•[;]-  [Sisj[;]  ♦[{]• 

[8:g  8:?]  ;]*[?] 


Each  transformation  must  also  have  an 
associated  probability,  p,.  determining  its 
“importance”  relative  to  the  other  trans¬ 


formations.  In  the  present  case  we  might 
have  Px,pi,  and  p, .  Notice  that  the  proba¬ 
bilities  must  add  up  to  1 .  That  is,  p,  + 
Pi  +Ps  ■  1 

Of  course,  the  above  notation  for  an 
IFS  is  cumbersome.  Table  1  expresses 
the  same  information  in  tabular  form. 
Other  examples  of  IFS  codes  are  given 
in  tables  2  through  4.  Notice  that  an  IFS 
can  contain  any  number  of  affine 
transformations. 

The  Random  Iteration  Algorithm 
Now  let’s  see  how  to  decode  an  arbitrary 
IFS  code  using  the  random  iteration 
method.  Remember  that  in  general  an 
IFS  can  contain  any  number,  say  m,  of  af¬ 
fine  transformations,  W,,  R'j,  W, . 

Wm,  each  with  an  associated  probability. 
The  following  code  summarizes  the 
method: 


Figure  8:  The  result  of  applying  the  random  iteration  algorithm  to  the  IFS  code  in 
table  I.  It  is  called  the  Sierpihski  triangle. 


(i)  Initialize:  *»0,  y=0. 

(ii)  For  n- 1  to  2500,  do  steps  (iii)-(vh). 

(iii)  Choose  k  to  be  one  of  the  numbers  1 , 

2 . m,  with  probability  pt. 

(iv)  Apply  the  transformation  Wt  to  the 
point  (x,y)  to  obtain  (*,>•). 

(v)  Set  (x,y)  equal  to  the  new  point:  x -x. 

y=y. 

(vi)  Ifn>  10,  plot  (jr,y). 

(vii)  Loop. 

Applying  this  procedure  to  the  trans¬ 
formation  in  table  1  produces  the  figure 
shown  in  figure  8— a  fractal  known  as  the 
Sierpihski  triangle.  Increasing  the  num¬ 
ber  of  iterations  n  adds  points  to  the 
image.  Figure  9  shows  the  result  of  the 
random  iteration  algorithm  applied  to  the 
dau  in  table  3,  at  several  stages  during 
the  process.  By  increasing  the  scale  fac¬ 
tor  used  in  plotting,  you  can  zoom  in  on 
the  image  (see  figure  10).  The  text  box  on 
page  221  contains  a  BASIC  implementa¬ 
tion  of  the  method  with  additional  com¬ 
ments  on  programming. 

You  may  wonder  why  the  first  10 
points  are  not  plotted  (step  (vi)).  This  is 
to  give  the  randomly  dancing  point  time 
to  settle  down  on  the  image.  It  is  like  a 
soccer  ball  thrown  onto  a  field  of  expen 
players:  Until  someone  gains  control  of 
the  ball,  its  motion  is  unpredictable,  or  at 
least  is  independent  of  the  players’  ac¬ 
tions.  But  eventually  a  player  gets  the 
ball,  and  its  motion  then  becomes  a  direct 
result  of  the  skill  of  the  players.  The  fact 
that  our  transformation  is  contractive 
guarantees  that  the  "baU"  will  eventually 
get  to  one  of  the  "players,"  and  that  it 
will  stay  under  control  after  that. 

How  do  we  know  that  the  random  iter- 
continued 
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ation  algorithm  will  produce  the  same 
image  over  and  over  again,  independent 
of  the  particular  sequence  of  random 
choices  that  are  made?  This  remarkable  re¬ 
sult  was  first  suggested  by  computer-graph¬ 
ical  mathematics  experiments  and  later 
given  a  rigorous  theoretical  foundation  by 
Georgia  Tech  mathematician  John  Elton. 

The  Collage  Theorem 

Our  next  goal  is  to  show  a  systematic 
method  for  finding  the  affine  transforma¬ 
tions  that  will  produce  an  IFS  encoding  of 
a  desired  image.  This  is  achieved  with  the 
help  of  the  Collage  Theorem. 

To  illustrate  the  method,  we  start  from 
a  picture  of  a  filled-in  square  S  in  the  x,y 


plane,  with  its  vertices  at  (0.0),  (1,0), 
(1.1),  and  (0,1)  (see  figure  11),  The  ob¬ 
jective  is  to  choose  a  set  of  contractive  af¬ 
fine  transformations,  in  this  case  Wt,  Wj, 
Mj,  fVt,  so  that  5  is  approximated  as  well 
as  possible  by  the  union  of  the  four  sub¬ 
images  H',<S>UWJ(S)UW'3(5)UW.,(5). 
Figure  11  shows,  on  the  left,  S  together 
with  four  noncovering  affine  transforma¬ 
tions  of  it;  on  the  right,  the  affine  trans¬ 
formations  have  been  adjusted  to  make 
the  union  of  the  transformed  images  cover 
up  the  square. 

To  find  the  coefficients  of  these  trans¬ 
formations,  we  use  the  method  described 
earlier  in  the  section  on  iterated  function 
systems,  leading  to  simultaneous  equa¬ 


tions  1  through  3  and  4  through  6.  The 
values  one  finds  in  the  present  case  are 
given  in  table  2.  When  the  random  itera¬ 
tion  algorithm  is  applied  to  this  IFS  code, 
the  square  is  regenerated. 

The  preceding  example  typifies  the 
general  situation:  You  need  to  find  a  set 
of  affine  transformations  that  shrink  dis¬ 
tances  and  that  cause  the  target  image  to 
be  approximated  by  the  union  of  the  af¬ 
fine  transformations  of  the  image.  The 
Collage  Theorem  says  that  the  more  ac¬ 
curately  the  image  is  described  in  this 
way,  the  more  accurately  the  transforma¬ 
tions  provide  an  IFS  encoding  of  it. 

Figure  12  provides  another  illustration 
of  the  Collage  Theorem.  At  the  bonom 
left  is  shown  a  polygonalized  leaf  bound¬ 
ary,  together  with  four  affine  transforma¬ 
tions  of  that  boundary.  The  transformed 
leaves  taken  together  do  not  form  a  very 
good  approximation  of  the  leaf;  in  conse¬ 
quence.  the  corresponding  IFS  image 
(bottom  right),  computed  using  the  ran¬ 
dom  iteration  algorithm,  does  not  look 
much  like  the  original  leaf  image.  How¬ 
ever,  as  the  collage  is  made  more  accu¬ 
rate  (upper  left),  the  decoded  image 
(upper  right)  becomes  more  accurate. 

So,  there's  a  fundamental  stability 
here.  You  don’t  have  to  get  the  IFS  code 
exactly  right  in  order  to  capture  a  good 
likeness  of  your  original  image.  More¬ 
over,  the  IFS  code  is  robust:  Small  per¬ 
turbations  in  the  code  will  not  result  in 
unacceptable  damage  to  the  image.  In 
each  of  the  above  examples,  we  have  used 
four  transformations  to  encode  the  image. 
However,  any  number  can  be  used. 

For  example,  the  spiral  image  in  figure 
13  can  be  encoded  with  just  two  contrac¬ 
tive  affine  transformations.  See  if  you  can 
find  them.  Then  determine  the  IFS  trans¬ 
formation  coefficients  and  input  them  to 
the  random  iteration  algorithm  to  get  the 
spiral  back  again. 


Figure  10:  Successive  zooms  on  pieces  of  an  IFS-encoded  fern. 


Figure  1 1 :  The  collage  theorem  is  used  to  encode  a  classical  square  S.  The  correct  IFS  code  is  obtained  when  the  four  affine 
transformations  of  S  cover  S,  as  shown  on  the  right. 
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Assigning  Probabilities 

Once  you  have  defined  your  transforma¬ 
tions,  you  need  to  assign  probabilities  to 
them.  Different  choices  of  probabilities 
do  not  in  general  lead  to  different  images, 
but  they  do  affect  the  rate  at  which  vari¬ 
ous  regions  or  attributes  of  the  image  are 


filled  in.  Let  the  affine  transformations 
W,  corresponding  to  an  image  I  be 
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where  i  =  1,  2,  3,...,  n.  Then  the 


amount  of  time  that  the  randomly  dancing 
point  should  spend  in  the  subimage  W  is 
approximately  equal  to 

area  of  W: 
area  of / 

continued 


IFS  Decoding 
in  BASIC 

Listing  A  is  a  BASIC  implementation 
of  the  random  iteration  algorithm. 
It  includes  the  data  for  the  Sierpihski  tri¬ 
angle,  but  you  can  use  it  to  process  any 
IFS  tables.  In  particular,  you  will  want 
to  try  the  data  in  tables  2,  3.  and  4.  Be 
sure  to  set  the  variable  m  correctly;  it 
tells  the  program  how  many  transforma¬ 
tions  are  in  the  IFS. 

It  is  also  essential  that  the  probabili¬ 
ties  in  p( )  add  up  to  1.  For  speed,  the 
transformations  should  be  listed  in  de¬ 
scending  order  of  probability:  the  high¬ 
est  probability  transformation  first,  and 
the  lowest  probability  last. 

The  program  includes  variables  for 
rescaling  and  translating  the  origin  to 
accommodate  the  range  of  the  points  be¬ 
ing  plotted  to  the  limits  of  your  screen.  If 
the  image  is  too  wide,  decrease  xscale; 
if  the  points  are  too  close  horizontally, 
increase  xscale.  Adjust  yscale  simi¬ 
larly  to  get  a  good  vertical  point  spread. 
To  move  the  image,  adjust  xoffset  and 
yoffset. 

You  can  do  these  adjustments  by  trial 
and  error:  Run  the  program;  interrupt  it 
and  change  the  offsets  and  scale  factors; 
and  run  it  again.  Or,  you  can  replace  the 
plot  command  pset  with  a  command  to 
print  the  values  of  x  and  y  and  run  the 
program  to  get  an  exact  idea  of  the  range 
of  points  being  plotted,  so  you  can  adjust 
the  scale  and  offsets  more  precisely. 

Another  way  to  arrange  the  program 
is  to  have  it  read  all  the  data— m,  a( ) , 
b().  c (  ) ,  d(),  e (  ) ,  f(),  p(), 
xscale,  yscale,  xoffset,  and  yoff¬ 
set— from  a  disk  File  specified  by  the 
user.  Instead  of  reading  in  the  coeffi¬ 
cients  a,  b,  c,  and  d,  you  may  want  to 
read  in  angles  6  and  <t>  and  scale  factors  r 
and  s,  and  then  calculate  the 
coefficients. 

The  random  iteration  method  is  com¬ 
putation-intensive,  so  we  recommend 
use  of  a  compiler  such  as  Microsoft's 
QuickBASIC  ui  Borland's  Tui'uo 
BASIC.  If  your  computer  has  a  floating¬ 
point  coprocessor  and  your  compiler 
supports  one,  so  much  the  better. 


Listing  A:  A  BASIC  program  demonstrating  the  use  of  the  random 
iteration  algorithm  to  reconstruct  an  IFS-compressed  image. 

18  ‘Allow  for  a  maximum  of  4  transformations  in  the  IFS 
28  DIM  a(t),  b  ( 4) »  c  (4 ) .  d(4),  e  (4  > ,  f<4),  p(4) 

38  * 

48  ‘Transformation  data,  Sierpinski  triangle 
58  ‘First  comes  the  number  of  transformations 
60  ‘then  the  coefficients  a  through  f  and  probability  pk 
70  ‘The  values  for  pk  should  be  in  descending  order. 

80  DATA  3 

90  DATA  .5,8,0,  .5,8,8, .34 
188  DATA  .5,0,8, .5,1,8, .33 
118  DATA  .5,8,0, .5,  .5,  .5, .33 
120  ‘ 

130  ‘Read  in  the  data 
140  READ  m 

150  pt  -  8  ‘Cumulative  probability 
160  FOR  j  -  1  TO  m 

170  READ  a  { j) ,  b(j),  c(j),  d(j),  e(j),  f  ( j)  ,  pk 
188  pt  -  pt  +  pk 
190  p< j)  -  pt 
200  NEXT  j 
210  ‘ 

228  ‘Set  up  for  Graphics 

238  SCREEN  3  ‘Select  graphics  screen 

240  xscale  ■«  350  ‘Map  [0,1]  onto  [0,350] 

250  yscale  *  325  ‘Map  [0,1]  onto  [8,325] 

268  xoffset  -  0 
270  yoffset  -  0 
280  ‘ 

290  ‘Initialize 
380  x  -  0 
310  y  -  0 
320  ‘ 

330  ‘Do  2500  iterations 
340  FOR  n  -  1  TO  2500 
350 
360 

370  ‘for  values  of  m  >  4. 

380  IF  pk  <-  p ( 1)  THEN  k  -  1  ELSE  IF  pk  <-  p(2>  THEN  k  -  2 
ELSE  IF  pk  <-  p (3)  THEN  k  -  3  ELSE  k  -  4 
390  newx  -  a  (k)  *  x  +  b(k)  *  y  +  e(k) 

408  newy  -  c(k)  *  x  +  d(k)  *  y  +  f  (k) 

418  x  -  newx 

420  y  -  newy 

430  ‘Use  PRINT  x, y  instead  of  the  PSET  line 

440  ‘to  see  the  range  of  coordinates.  Then  fix 
450  ‘xscale,  yscale,  xoffset.  and  yoffset 

460  IF  n  >  10  THEN  PSET  (x  *  xscale  +  xoffset,  y  *  yscale 
+  yoffset) 

470  NEXT  n 
488  ‘ 

490  LOCATE  24,  35 

580  PRINT  "Press  any  key  to  end."; 

510  WHILE  INKEYS  -  "" 

520  WEND 
530  ‘ 

540  ‘Return  to  text  screen 
550  SCREEN  0 
560  END 


‘Leave  the  y-origin 
and  y 


pk  -  RND 

‘The  next  line  works  for  m<-4 .  It  must  be  modified 
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Figure  12:  The  Collage  Theorem  is  applied  to  a  leaf.  The  collage  at  lower  left  isn 't 
much  good,  so  the  corresponding  IFS  image,  shown  at  lower  right,  is  a  poor 
approximation.  But  as  the  collage  improves,  upper  left,  so  does  the  IFS  image. 


Rfure  13;  Can  you  find  the  IFS  codes  for  this  spiral  image  ?  Only  two 
transformations  are  needed. 


So  long  as  ad  -  cd  is  noi  0,  it  is  a  stan¬ 
dard  calculus  result  that  our  ratio  equals 
the  determinant  of  the  transformation  ma¬ 
trix  for  If',.  So  a  good  choice  lor  the  prob¬ 
ability/)  is 


a  dt  — be 

t,  \a,d,-hl(,\ 

i  *  I 

provided  none  ol  these  numbers/),  comes 
out  to  be  0.  A  0  value  should  be  replaced 
by  a  very  small  positive  value,  such  as 
0.001,  and  the  other  probabilities  corre¬ 
spondingly  adjusted  to  keep  the  sum  of  all 
the  probabilities  equal  to  I . 

We  now  summarize  the  compression 
and  decompression  process:  An  input 
image  is  broken  up  into  segments  through 
image-processing  techniques.  These 
image  components  are  looked  up  in  the 
IFS  library  using  the  Collage  Theorem, 
and  their  IFS  codes  are  recorded.  When 
the  image  is  to  be  reconstructed,  the  IFS 
codes  are  input  to  the  random  iteration  al¬ 
gorithm.  The  accuracy  of  the  recon¬ 
structed  image  depends  only  on  the  toler¬ 
ance  setting  used  during  the  collage 
mapping  stage. 

Applications 

For  graphics  applications,  we  use  a  more 
sophisticated  procedure  that  allows  fulJ- 
color  images  to  be  encoded.  Combina¬ 
torial  searching  algorithms  can  be  used  to 
automate  the  collage  mapping  stage.  Fig¬ 
ures  2,  3.  and  4  were  obtained  using  IFS 
theory  at  compression  ratios  in  excess  of 
10.000  to  1 .  These  images  were  based  on 
photographs  in  recent  issues  of  National 
Geographic.  A  full-sequence  video  ani¬ 
mation.  A  Cloud  Study,  was  shown  at 
SIGGRAPH  ’87.  This  was  encoded  at  a 
ratio  exceeding  1 .000.000  to  1  and  can  be 
transmitted  in  encoded  form  at  video 
rates  over  ISDN  lines  (ISDN  stands  for 
integrated  services  digital  network,  a 
concept  for  integrated  voice  and  data 
communications).  A  frame  from  the  ani¬ 
mation  is  shown  in  figure  5. 

The  IFS  compression  technique  is 
computation-intensive  in  both  the  encod¬ 
ing  and  decoding  phases.  Computations 
for  the  color  images  were  all  carried  out 
on  Masscomp  5600  workstations  (dual 
68020-based  systems)  with  Aurora 
graphics.  Complex  color  images  require 
about  100  hours  each  to  encode  and  30 
minutes  to  decode  on  the  Masscomp. 

For  practical  applications,  you  need 
custom  hardware  that  can  speed  the  en¬ 
coding  and  decoding  process.  An  experi¬ 
mental  prototype,  the  IFSIS  (iterated 
function  system-image  synthesizer),  de¬ 
codes  at  the  rate  of  several  frames  per 
second.  The  IFSIS  device  was  produced 
from  a  cooperative  effort  between  GTRC, 
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DARPA.  Atlantic  Aerospace  Electronics 
Corporation,  and  Iterated  Systems,  and  it 
was  demonstrated  on  October  5,  1987,  at 
the  third  annual  meeting  of  the  Applied  and 
Computational  Mathematics  Program  of 
DARPA.  It  can  be  connected  to  a  personal 
computer  through  a  serial  port;  the  per¬ 
sonal  computer  sends  the  IFS  codes  to  the 
device,  which  responds  by  producing  com¬ 
plex  color  images  on  a  monitor. 

The  IFSIS  is  a  proof  of  concept  for 
faster  devices  with  higher  resolution. 
Once  the  higher-performance  IFSIS  de¬ 
vices  are  combined  with  ISDN  telecom¬ 
munication,  full-color  animation  at  video 
rates  over  phone  lines  will  be  a  reality. 

Another  area  for  future  application  of 
IFS  encoding  is  automatic  image  analy¬ 
sis.  What's  in  a  picture?  Does  it  show  a 
spotted  sandpiper  or  a  robin?  The  more 
complex  the  image  or  the  more  subtle  the 
question,  the  harder  it  becomes  for  an  al¬ 
gorithmic  answer  to  be  formulated.  But 
here's  the  point:  Whatever  the  answer,  it 
will  proceed  faster  if  stable,  compressed 
images  are  used.  The  reason  for  this  is 
that  image-recognition  problems  involve 
combinatorial  searching,  and  searching 
times  increase  factorially  with  the  size  of 
the  image  file. 

During  the  spring  of  1987,  Iterated 
Systems  was  incorporated  to  develop 
commercial  applications  of  IFS  image 
compression.  It  is  exciting  to  see  how  an 
abstract  field  of  mathematics  research  is 
leading  to  new  technology  with  implica¬ 
tions  ranging  from  commercial  and  in¬ 
dustrial  work  to  personal  computing.  ■ 
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